Apr 24 00:04:57 user devstack@n-api.service[61490]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 24 00:04:57 user devstack@n-api.service[61490]: *** Starting uWSGI 2.0.20-debian (64bit) on [Mon Apr 24 00:04:57 2023] *** Apr 24 00:04:57 user devstack@n-api.service[61490]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 24 00:04:57 user devstack@n-api.service[61490]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 24 00:04:57 user devstack@n-api.service[61490]: nodename: user Apr 24 00:04:57 user devstack@n-api.service[61490]: machine: x86_64 Apr 24 00:04:57 user devstack@n-api.service[61490]: clock source: unix Apr 24 00:04:57 user devstack@n-api.service[61490]: pcre jit disabled Apr 24 00:04:57 user devstack@n-api.service[61490]: detected number of CPU cores: 12 Apr 24 00:04:57 user devstack@n-api.service[61490]: current working directory: / Apr 24 00:04:57 user devstack@n-api.service[61490]: detected binary path: /usr/bin/uwsgi-core Apr 24 00:04:57 user devstack@n-api.service[61490]: your processes number limit is 63637 Apr 24 00:04:57 user devstack@n-api.service[61490]: your memory page size is 4096 bytes Apr 24 00:04:58 user devstack@n-api.service[61490]: detected max file descriptor number: 2048 Apr 24 00:04:58 user devstack@n-api.service[61490]: lock engine: pthread robust mutexes Apr 24 00:04:58 user devstack@n-api.service[61490]: thunder lock: enabled Apr 24 00:04:58 user devstack@n-api.service[61490]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 24 00:04:58 user devstack@n-api.service[61490]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 24 00:04:58 user devstack@n-api.service[61490]: Python main interpreter initialized at 0x563c297a1990 Apr 24 00:04:58 user devstack@n-api.service[61490]: python threads support enabled Apr 24 00:04:58 user devstack@n-api.service[61490]: your server socket listen backlog is limited to 100 connections Apr 24 00:04:58 user devstack@n-api.service[61490]: your mercy for graceful operations on workers is 90 seconds Apr 24 00:04:58 user devstack@n-api.service[61490]: mapped 537436 bytes (524 KB) for 3 cores Apr 24 00:04:58 user devstack@n-api.service[61490]: *** Operational MODE: preforking *** Apr 24 00:04:58 user devstack@n-api.service[61490]: *** uWSGI is running in multiple interpreter mode *** Apr 24 00:04:58 user devstack@n-api.service[61490]: spawned uWSGI master process (pid: 61490) Apr 24 00:04:58 user devstack@n-api.service[61490]: spawned uWSGI worker 1 (pid: 61491, cores: 1) Apr 24 00:04:58 user devstack@n-api.service[61490]: spawned uWSGI worker 2 (pid: 61492, cores: 1) Apr 24 00:04:58 user devstack@n-api.service[61490]: spawned uWSGI worker 3 (pid: 61493, cores: 1) Apr 24 00:04:58 user devstack@n-api.service[61490]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 24 00:04:58 user devstack@n-api.service[61491]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 24 00:04:58 user devstack@n-api.service[61493]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 24 00:04:58 user devstack@n-api.service[61492]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 24 00:05:02 user devstack@n-api.service[61493]: live_migration_uri is deprecated for removal in favor of two other options that Apr 24 00:05:02 user devstack@n-api.service[61493]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 24 00:05:02 user devstack@n-api.service[61493]: and ``live_migration_inbound_addr`` respectively. Apr 24 00:05:02 user devstack@n-api.service[61493]: ). Its value may be silently ignored in the future. Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 24 00:05:02 user devstack@n-api.service[61492]: live_migration_uri is deprecated for removal in favor of two other options that Apr 24 00:05:02 user devstack@n-api.service[61492]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 24 00:05:02 user devstack@n-api.service[61492]: and ``live_migration_inbound_addr`` respectively. Apr 24 00:05:02 user devstack@n-api.service[61492]: ). Its value may be silently ignored in the future. Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 24 00:05:02 user devstack@n-api.service[61491]: live_migration_uri is deprecated for removal in favor of two other options that Apr 24 00:05:02 user devstack@n-api.service[61491]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 24 00:05:02 user devstack@n-api.service[61491]: and ``live_migration_inbound_addr`` respectively. Apr 24 00:05:02 user devstack@n-api.service[61491]: ). Its value may be silently ignored in the future. Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61493) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61492) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61491) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 24 00:05:02 user devstack@n-api.service[61493]: INFO dbcounter [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Registered counter for database nova_api Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_db.sqlalchemy.engines [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61493) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writer thread running {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61492]: INFO dbcounter [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Registered counter for database nova_api Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_db.sqlalchemy.engines [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61492) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writer thread running {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61491]: INFO dbcounter [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Registered counter for database nova_api Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_db.sqlalchemy.engines [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61491) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG nova.context [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a345e55a-e119-441a-a250-b58384b04676(cell1) {{(pid=61493) load_cells /opt/stack/nova/nova/context.py:464}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writer thread running {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:05:02 user devstack@n-api.service[61493]: INFO dbcounter [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Registered counter for database nova_cell0 Apr 24 00:05:02 user devstack@n-api.service[61493]: INFO dbcounter [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Registered counter for database nova_cell1 Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_db.sqlalchemy.engines [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61493) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_db.sqlalchemy.engines [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61493) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG nova.context [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a345e55a-e119-441a-a250-b58384b04676(cell1) {{(pid=61492) load_cells /opt/stack/nova/nova/context.py:464}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writer thread running {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writer thread running {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:05:02 user devstack@n-api.service[61492]: INFO dbcounter [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Registered counter for database nova_cell0 Apr 24 00:05:02 user devstack@n-api.service[61492]: INFO dbcounter [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Registered counter for database nova_cell1 Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG nova.context [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a345e55a-e119-441a-a250-b58384b04676(cell1) {{(pid=61491) load_cells /opt/stack/nova/nova/context.py:464}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_db.sqlalchemy.engines [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61492) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61491]: INFO dbcounter [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Registered counter for database nova_cell0 Apr 24 00:05:02 user devstack@n-api.service[61491]: INFO dbcounter [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Registered counter for database nova_cell1 Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writer thread running {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_db.sqlalchemy.engines [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61492) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_db.sqlalchemy.engines [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61491) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writer thread running {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_db.sqlalchemy.engines [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61491) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61493]: INFO dbcounter [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Registered counter for database nova_cell0 Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG oslo_db.sqlalchemy.engines [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61493) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writer thread running {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writer thread running {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writer thread running {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61492]: INFO dbcounter [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Registered counter for database nova_cell0 Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG oslo_db.sqlalchemy.engines [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61492) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writer thread running {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:02 user devstack@n-api.service[61491]: INFO dbcounter [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Registered counter for database nova_cell0 Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG oslo_db.sqlalchemy.engines [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61491) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 24 00:05:02 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writer thread running {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 24 00:05:03 user devstack@n-api.service[61493]: WARNING keystonemiddleware.auth_token [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 24 00:05:03 user devstack@n-api.service[61493]: WARNING keystonemiddleware.auth_token [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 24 00:05:03 user devstack@n-api.service[61491]: WARNING keystonemiddleware.auth_token [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 24 00:05:03 user devstack@n-api.service[61491]: WARNING keystonemiddleware.auth_token [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 24 00:05:03 user devstack@n-api.service[61493]: WARNING keystonemiddleware.auth_token [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 24 00:05:03 user devstack@n-api.service[61493]: WARNING keystonemiddleware.auth_token [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 24 00:05:03 user devstack@n-api.service[61493]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c297a1990 pid: 61493 (default app) Apr 24 00:05:03 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:05:03 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001650 Apr 24 00:05:03 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Mon Apr 24 00:05:03 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:05:03 user devstack@n-api.service[61492]: WARNING keystonemiddleware.auth_token [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 24 00:05:03 user devstack@n-api.service[61492]: WARNING keystonemiddleware.auth_token [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 24 00:05:03 user devstack@n-api.service[61491]: WARNING keystonemiddleware.auth_token [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 24 00:05:03 user devstack@n-api.service[61491]: WARNING keystonemiddleware.auth_token [None req-c4477603-98df-41e3-ad8d-978c24da901a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 24 00:05:03 user devstack@n-api.service[61491]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c297a1990 pid: 61491 (default app) Apr 24 00:05:03 user devstack@n-api.service[61492]: WARNING keystonemiddleware.auth_token [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 24 00:05:03 user devstack@n-api.service[61492]: WARNING keystonemiddleware.auth_token [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 24 00:05:03 user devstack@n-api.service[61492]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563c297a1990 pid: 61492 (default app) Apr 24 00:07:09 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:09 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3ddf34ff-c0f8-4d51-8dd3-1f1886936d7b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001523 Apr 24 00:07:09 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:09 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-4c956e21-f0df-4bf1-8851-5305661d393e admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:09 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-4c956e21-f0df-4bf1-8851-5305661d393e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.390744 Apr 24 00:07:09 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Mon Apr 24 00:07:09 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:11 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:11 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002579 Apr 24 00:07:11 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:11 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:11 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:11 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:11 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:11 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:11 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-232013f3-a891-4745-aedd-88dad49c6e56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "swap": 0}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:11 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-232013f3-a891-4745-aedd-88dad49c6e56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.338009 Apr 24 00:07:11 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:11 2023] POST /compute/v2.1/flavors => generated 405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:11 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-607ca3d6-afc7-4910-8c2b-55d9aaf23fd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:12 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-607ca3d6-afc7-4910-8c2b-55d9aaf23fd2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044155 Apr 24 00:07:12 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 24 00:07:11 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:13 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:13 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001968 Apr 24 00:07:13 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:13 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:13 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-9949e469-624f-4795-abf3-10d712cf59e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:14 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-9949e469-624f-4795-abf3-10d712cf59e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063004 Apr 24 00:07:14 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:13 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c698c7aa-adb9-4f46-9fbf-4cb36f7801c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-c698c7aa-adb9-4f46-9fbf-4cb36f7801c1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027040 Apr 24 00:07:14 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 24 00:07:14 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 24 00:07:15 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:15 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001868 Apr 24 00:07:15 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:15 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-bfa128be-5c4b-45ca-b8d0-c52c2800d6d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "name": "ds1G", "disk": 10}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:16 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-bfa128be-5c4b-45ca-b8d0-c52c2800d6d2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065162 Apr 24 00:07:16 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:15 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:16 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-1660c75c-1c77-4482-8a2c-6ac5415aed2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-1660c75c-1c77-4482-8a2c-6ac5415aed2a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028799 Apr 24 00:07:16 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 24 00:07:16 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:17 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001543 Apr 24 00:07:17 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:17 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-72e3719a-6396-412c-9b47-5561c842ae55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-72e3719a-6396-412c-9b47-5561c842ae55 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061357 Apr 24 00:07:18 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:17 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:18 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-df5ea1d0-f0f9-41ce-a6ef-d569ce629460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:18 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-df5ea1d0-f0f9-41ce-a6ef-d569ce629460 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035676 Apr 24 00:07:18 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 24 00:07:18 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:19 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001632 Apr 24 00:07:19 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:19 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:19 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3db8e676-26c0-4b30-bf59-66edafe80edb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "id": "d4", "name": "ds4G"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:20 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3db8e676-26c0-4b30-bf59-66edafe80edb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058781 Apr 24 00:07:20 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:19 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:20 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:20 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028504 Apr 24 00:07:20 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 24 00:07:20 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:21 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:21 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e336bfb8-74cf-4239-92f0-2cf5431d6276 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001595 Apr 24 00:07:21 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:21 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-db7040b4-55a5-4a67-80aa-3444af04604a admin admin] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-db7040b4-55a5-4a67-80aa-3444af04604a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.092144 Apr 24 00:07:21 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Mon Apr 24 00:07:21 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:07:23 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:23 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001476 Apr 24 00:07:23 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:23 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=3 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:23 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=3 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:23 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=3 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:23 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=3 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:07:24 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-a551ca43-6d5c-4efe-a814-8b11052e07ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:24 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-a551ca43-6d5c-4efe-a814-8b11052e07ff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.334566 Apr 24 00:07:24 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:23 2023] POST /compute/v2.1/flavors => generated 400 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:24 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-97fefec0-d189-4474-8551-e5a6c0a5625b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:24 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-97fefec0-d189-4474-8551-e5a6c0a5625b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037804 Apr 24 00:07:24 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 24 00:07:24 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:26 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:26 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001291 Apr 24 00:07:26 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:26 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-dac6369b-25e0-4880-bfa1-c65d451465d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:26 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-dac6369b-25e0-4880-bfa1-c65d451465d9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.058421 Apr 24 00:07:26 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:26 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:26 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-d24547b7-28f2-4cae-b9cb-cf70f84b75cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:26 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-d24547b7-28f2-4cae-b9cb-cf70f84b75cc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025763 Apr 24 00:07:26 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 24 00:07:26 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:28 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:28 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001337 Apr 24 00:07:28 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:28 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-724d5f18-8fa2-4228-bb6d-0b30bfc62ddb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "ram": 4096}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:28 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-724d5f18-8fa2-4228-bb6d-0b30bfc62ddb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059632 Apr 24 00:07:28 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:28 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:28 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-5b10853d-bc1d-4522-a357-5cb9638c1864 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:28 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-5b10853d-bc1d-4522-a357-5cb9638c1864 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024297 Apr 24 00:07:28 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 24 00:07:28 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:30 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:30 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002221 Apr 24 00:07:30 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:30 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:30 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-aca67805-8c43-46fb-8dc3-be4085029207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:30 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-aca67805-8c43-46fb-8dc3-be4085029207 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059298 Apr 24 00:07:30 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:30 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:30 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-b4d4315f-4032-4453-ae13-d6a93478d891 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:30 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-b4d4315f-4032-4453-ae13-d6a93478d891 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023576 Apr 24 00:07:30 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 24 00:07:30 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:07:32 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:07:32 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001772 Apr 24 00:07:32 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 24 00:07:32 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:07:32 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-3c688648-85c9-4eba-8724-63fdd99c1434 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:32 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-3c688648-85c9-4eba-8724-63fdd99c1434 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.116342 Apr 24 00:07:32 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 24 00:07:32 2023] POST /compute/v2.1/flavors => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:07:32 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-a19a939a-f11b-453f-8baa-71117b969dcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:07:32 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-a19a939a-f11b-453f-8baa-71117b969dcd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025142 Apr 24 00:07:32 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 24 00:07:32 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:08:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:08:02 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-24287a9e-7e92-4d02-9432-e17e4e738cdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002614 Apr 24 00:08:02 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 24 00:08:02 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:08:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:08:03 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.091396 Apr 24 00:08:03 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Mon Apr 24 00:08:02 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:08:34 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-a19a939a-f11b-453f-8baa-71117b969dcd admin admin] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:08:34 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-a19a939a-f11b-453f-8baa-71117b969dcd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001589 Apr 24 00:08:34 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 24 00:08:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:08:34 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:08:34 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fce4be56-9217-42d2-8035-25f08e749361 admin admin] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:08:34 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-fce4be56-9217-42d2-8035-25f08e749361 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.086637 Apr 24 00:08:34 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Mon Apr 24 00:08:34 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:08:39 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:08:39 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002806 Apr 24 00:08:39 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 24 00:08:39 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:08:39 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:08:39 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ed3c6517-9662-4327-8353-e11c9d15e8f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "id": "42", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 128, "swap": 0, "disk": 1}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:08:39 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-ed3c6517-9662-4327-8353-e11c9d15e8f0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069484 Apr 24 00:08:39 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Mon Apr 24 00:08:39 2023] POST /compute/v2.1/flavors => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:08:39 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-829f61a9-71ca-4239-bced-ceb1a1cbc19b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:08:39 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-829f61a9-71ca-4239-bced-ceb1a1cbc19b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026329 Apr 24 00:08:39 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Mon Apr 24 00:08:39 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:08:43 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:08:43 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-179af6ca-a1f2-4093-8dd1-07bb1930a046 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001611 Apr 24 00:08:43 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 24 00:08:43 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:08:43 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-d3135bea-bd99-4d17-bf38-4c433f6dcfdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.micro", "rxtx_factor": 1.0, "disk": 1, "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "84"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:08:43 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-d3135bea-bd99-4d17-bf38-4c433f6dcfdb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060247 Apr 24 00:08:43 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Mon Apr 24 00:08:43 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:08:43 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ee3e9bc5-9ed9-41f8-931e-f46585a49cf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:08:43 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-ee3e9bc5-9ed9-41f8-931e-f46585a49cf5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025248 Apr 24 00:08:43 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Mon Apr 24 00:08:43 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f9de6a88-b77c-4213-9aa6-0d86c33d81ea tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Action: 'create', calling method: .version_select at 0x7fc8c459acb0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1640431164", "metadata": {"Type": "work"}}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f9de6a88-b77c-4213-9aa6-0d86c33d81ea tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Request method failure captured: Apr 24 00:10:54 user devstack@n-api.service[61492]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 24 00:10:54 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:10:54 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:10:54 user devstack@n-api.service[61492]: Connection: close Apr 24 00:10:54 user devstack@n-api.service[61492]: Content-Length: 122 Apr 24 00:10:54 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:10:54 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:10:54 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:10:54 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRckNJPBgqEbAPZjI7zRkEO7PVdxePwXQISHWApvwh_c_xUVme0z6QqAb1uITTOB8A5uCEAuZ2u_d1u4_G0YQs-HeqbQ_EPK2r83wNf3FSwKjhgNT55zQBzsOXmNIrCW1j3gTjAGor-eOYE8cpHnlY6GekcMNFDCYd1LrHxqKke6JSCM Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/035d3182b1374522ae9840f2d7a5dd5c"}]}] Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Tenant: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Tenant-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Id: 2a74b1b533f34bca9093b4cac2ba5bc3 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Name: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61492]: Apr 24 00:10:54 user devstack@n-api.service[61492]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1640431164", "metadata": {"Type": "work"}}} Apr 24 00:10:54 user devstack@n-api.service[61492]: method: Apr 24 00:10:54 user devstack@n-api.service[61492]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61492]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1640431164', 'metadata': {'Type': 'work'}}}} Apr 24 00:10:54 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise error Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi '#$%' Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f9de6a88-b77c-4213-9aa6-0d86c33d81ea tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:10:54 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-f9de6a88-b77c-4213-9aa6-0d86c33d81ea tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.225441 Apr 24 00:10:54 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 24 00:10:54 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:10:54 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-e12cdfdb-52cf-43ca-8961-79f83cba2f57 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Action: 'create', calling method: .version_select at 0x7fc8c4581cf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-738113415", "metadata": {"Type": "work"}}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:10:54 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-e12cdfdb-52cf-43ca-8961-79f83cba2f57 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Request method failure captured: Apr 24 00:10:54 user devstack@n-api.service[61493]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 24 00:10:54 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:10:54 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:10:54 user devstack@n-api.service[61493]: Connection: close Apr 24 00:10:54 user devstack@n-api.service[61493]: Content-Length: 119 Apr 24 00:10:54 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:10:54 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:10:54 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:10:54 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRckNJPBgqEbAPZjI7zRkEO7PVdxePwXQISHWApvwh_c_xUVme0z6QqAb1uITTOB8A5uCEAuZ2u_d1u4_G0YQs-HeqbQ_EPK2r83wNf3FSwKjhgNT55zQBzsOXmNIrCW1j3gTjAGor-eOYE8cpHnlY6GekcMNFDCYd1LrHxqKke6JSCM Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Project-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Project-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/035d3182b1374522ae9840f2d7a5dd5c"}]}] Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Tenant: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Tenant-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61493]: X-User: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61493]: X-User-Id: 2a74b1b533f34bca9093b4cac2ba5bc3 Apr 24 00:10:54 user devstack@n-api.service[61493]: X-User-Name: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61493]: Apr 24 00:10:54 user devstack@n-api.service[61493]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-738113415", "metadata": {"Type": "work"}}} Apr 24 00:10:54 user devstack@n-api.service[61493]: method: Apr 24 00:10:54 user devstack@n-api.service[61493]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 24 00:10:54 user devstack@n-api.service[61493]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-738113415', 'metadata': {'Type': 'work'}}}} Apr 24 00:10:54 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise error Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi '0' Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 24 00:10:54 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-e12cdfdb-52cf-43ca-8961-79f83cba2f57 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:10:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-e12cdfdb-52cf-43ca-8961-79f83cba2f57 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017085 Apr 24 00:10:54 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 24 00:10:54 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:10:54 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-93d0d7d1-c093-4ebd-95db-91efb2b765fb tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Action: 'create', calling method: .version_select at 0x7fc8c457dfc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1051788989", "metadata": {"Type": "work"}}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:10:54 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-93d0d7d1-c093-4ebd-95db-91efb2b765fb tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Request method failure captured: Apr 24 00:10:54 user devstack@n-api.service[61491]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 24 00:10:54 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:10:54 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:10:54 user devstack@n-api.service[61491]: Connection: close Apr 24 00:10:54 user devstack@n-api.service[61491]: Content-Length: 119 Apr 24 00:10:54 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:10:54 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:10:54 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:10:54 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRckNJPBgqEbAPZjI7zRkEO7PVdxePwXQISHWApvwh_c_xUVme0z6QqAb1uITTOB8A5uCEAuZ2u_d1u4_G0YQs-HeqbQ_EPK2r83wNf3FSwKjhgNT55zQBzsOXmNIrCW1j3gTjAGor-eOYE8cpHnlY6GekcMNFDCYd1LrHxqKke6JSCM Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Project-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Project-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/035d3182b1374522ae9840f2d7a5dd5c"}]}] Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Tenant: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Tenant-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61491]: X-User: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61491]: X-User-Id: 2a74b1b533f34bca9093b4cac2ba5bc3 Apr 24 00:10:54 user devstack@n-api.service[61491]: X-User-Name: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61491]: Apr 24 00:10:54 user devstack@n-api.service[61491]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1051788989", "metadata": {"Type": "work"}}} Apr 24 00:10:54 user devstack@n-api.service[61491]: method: Apr 24 00:10:54 user devstack@n-api.service[61491]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61491]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1051788989', 'metadata': {'Type': 'work'}}}} Apr 24 00:10:54 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise error Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi '' Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 24 00:10:54 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-93d0d7d1-c093-4ebd-95db-91efb2b765fb tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:10:54 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-93d0d7d1-c093-4ebd-95db-91efb2b765fb tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013910 Apr 24 00:10:54 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 24 00:10:54 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1adc003f-e9e1-496d-9e3c-cb98043fba31 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Calling method '.version_select at 0x7fc8c4fad630>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:10:54 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-1adc003f-e9e1-496d-9e3c-cb98043fba31 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] HTTP exception thrown: Volume tempest-invalid-164855910 could not be found. Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1adc003f-e9e1-496d-9e3c-cb98043fba31 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Request method failure captured: Apr 24 00:10:54 user devstack@n-api.service[61492]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-164855910 HTTP/1.1 Apr 24 00:10:54 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:10:54 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:10:54 user devstack@n-api.service[61492]: Connection: close Apr 24 00:10:54 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:10:54 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:10:54 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:10:54 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:10:54 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRckNJPBgqEbAPZjI7zRkEO7PVdxePwXQISHWApvwh_c_xUVme0z6QqAb1uITTOB8A5uCEAuZ2u_d1u4_G0YQs-HeqbQ_EPK2r83wNf3FSwKjhgNT55zQBzsOXmNIrCW1j3gTjAGor-eOYE8cpHnlY6GekcMNFDCYd1LrHxqKke6JSCM Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Project-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/035d3182b1374522ae9840f2d7a5dd5c"}]}] Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Tenant: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Tenant-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:54 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Id: 2a74b1b533f34bca9093b4cac2ba5bc3 Apr 24 00:10:54 user devstack@n-api.service[61492]: X-User-Name: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:54 user devstack@n-api.service[61492]: method: Apr 24 00:10:54 user devstack@n-api.service[61492]: exception: Volume tempest-invalid-164855910 could not be found. Apr 24 00:10:54 user devstack@n-api.service[61492]: action_args: {'id': 'tempest-invalid-164855910'} Apr 24 00:10:54 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-164855910 could not be found. (HTTP 404) (Request-ID: req-76e7efe4-f89c-43e9-baf9-544eaaff6e60) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-164855910 could not be found. Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-164855910 could not be found. Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-164855910 could not be found. Apr 24 00:10:54 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1adc003f-e9e1-496d-9e3c-cb98043fba31 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Returning 404 to user: Volume tempest-invalid-164855910 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:10:54 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-1adc003f-e9e1-496d-9e3c-cb98043fba31 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-164855910" status: 404 len: 98 microversion: 2.1 time: 0.339534 Apr 24 00:10:54 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1292 bytes} [Mon Apr 24 00:10:54 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-164855910 => generated 98 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-d1eb804f-febd-44b8-82b1-b6e1104686fe tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006376 Apr 24 00:10:54 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Mon Apr 24 00:10:54 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-44e10ac7-acf6-4dfd-ae51-7bbe284d4712 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009432 Apr 24 00:10:54 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Mon Apr 24 00:10:54 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 24 00:10:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-44b9a522-c74f-4410-850e-ed13c06d1c02 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Calling method '.version_select at 0x7fc8c445dfc0>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:10:55 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-44b9a522-c74f-4410-850e-ed13c06d1c02 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] HTTP exception thrown: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. Apr 24 00:10:55 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-44b9a522-c74f-4410-850e-ed13c06d1c02 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Request method failure captured: Apr 24 00:10:55 user devstack@n-api.service[61492]: request: DELETE /compute/v2.1/os-volumes/fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 HTTP/1.1 Apr 24 00:10:55 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:10:55 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:10:55 user devstack@n-api.service[61492]: Connection: close Apr 24 00:10:55 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:10:55 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:10:55 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:10:55 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:10:55 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRckNJPBgqEbAPZjI7zRkEO7PVdxePwXQISHWApvwh_c_xUVme0z6QqAb1uITTOB8A5uCEAuZ2u_d1u4_G0YQs-HeqbQ_EPK2r83wNf3FSwKjhgNT55zQBzsOXmNIrCW1j3gTjAGor-eOYE8cpHnlY6GekcMNFDCYd1LrHxqKke6JSCM Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Project-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Project-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/035d3182b1374522ae9840f2d7a5dd5c"}]}] Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Tenant: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Tenant-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:55 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:55 user devstack@n-api.service[61492]: X-User: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:55 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:10:55 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:10:55 user devstack@n-api.service[61492]: X-User-Id: 2a74b1b533f34bca9093b4cac2ba5bc3 Apr 24 00:10:55 user devstack@n-api.service[61492]: X-User-Name: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:55 user devstack@n-api.service[61492]: method: Apr 24 00:10:55 user devstack@n-api.service[61492]: exception: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. Apr 24 00:10:55 user devstack@n-api.service[61492]: action_args: {'id': 'fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0'} Apr 24 00:10:55 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. (HTTP 404) (Request-ID: req-d6431d10-bbc8-408d-be92-36f208639a74) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. Apr 24 00:10:55 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-44b9a522-c74f-4410-850e-ed13c06d1c02 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Returning 404 to user: Volume fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:10:55 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-44b9a522-c74f-4410-850e-ed13c06d1c02 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0" status: 404 len: 109 microversion: 2.1 time: 0.686847 Apr 24 00:10:55 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:10:54 2023] DELETE /compute/v2.1/os-volumes/fed11ebb-8d02-4d3f-955b-a4fb6cbcc9e0 => generated 109 bytes in 688 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:10:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c3d1304b-9281-42e1-8599-93378527e017 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Calling method '.version_select at 0x7fc8c4582b90>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:10:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-c3d1304b-9281-42e1-8599-93378527e017 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] HTTP exception thrown: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. Apr 24 00:10:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c3d1304b-9281-42e1-8599-93378527e017 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Request method failure captured: Apr 24 00:10:55 user devstack@n-api.service[61493]: request: GET /compute/v2.1/os-volumes/9aa68439-2ba6-49c1-8ae9-692d91e86bfc HTTP/1.1 Apr 24 00:10:55 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:10:55 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:10:55 user devstack@n-api.service[61493]: Connection: close Apr 24 00:10:55 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:10:55 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:10:55 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:10:55 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:10:55 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRckNJPBgqEbAPZjI7zRkEO7PVdxePwXQISHWApvwh_c_xUVme0z6QqAb1uITTOB8A5uCEAuZ2u_d1u4_G0YQs-HeqbQ_EPK2r83wNf3FSwKjhgNT55zQBzsOXmNIrCW1j3gTjAGor-eOYE8cpHnlY6GekcMNFDCYd1LrHxqKke6JSCM Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Project-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Project-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/035d3182b1374522ae9840f2d7a5dd5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/035d3182b1374522ae9840f2d7a5dd5c"}]}] Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Tenant: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Tenant-Id: 035d3182b1374522ae9840f2d7a5dd5c Apr 24 00:10:55 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-VolumesNegativeTest-656701526 Apr 24 00:10:55 user devstack@n-api.service[61493]: X-User: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:55 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:10:55 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:10:55 user devstack@n-api.service[61493]: X-User-Id: 2a74b1b533f34bca9093b4cac2ba5bc3 Apr 24 00:10:55 user devstack@n-api.service[61493]: X-User-Name: tempest-VolumesNegativeTest-656701526-project-member Apr 24 00:10:55 user devstack@n-api.service[61493]: method: Apr 24 00:10:55 user devstack@n-api.service[61493]: exception: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. Apr 24 00:10:55 user devstack@n-api.service[61493]: action_args: {'id': '9aa68439-2ba6-49c1-8ae9-692d91e86bfc'} Apr 24 00:10:55 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. (HTTP 404) (Request-ID: req-912f45a1-2515-4c6f-8cdd-2f5c82a98eaa) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. Apr 24 00:10:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:10:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c3d1304b-9281-42e1-8599-93378527e017 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] Returning 404 to user: Volume 9aa68439-2ba6-49c1-8ae9-692d91e86bfc could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:10:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-c3d1304b-9281-42e1-8599-93378527e017 tempest-VolumesNegativeTest-656701526 tempest-VolumesNegativeTest-656701526-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9aa68439-2ba6-49c1-8ae9-692d91e86bfc" status: 404 len: 109 microversion: 2.1 time: 0.229317 Apr 24 00:10:55 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:10:55 2023] GET /compute/v2.1/os-volumes/9aa68439-2ba6-49c1-8ae9-692d91e86bfc => generated 109 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:11:01 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-285922937", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "6bffe37b-19f2-4b15-8425-82fe8d0b0c77"}]}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:01 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] validate_networks() for [('6bffe37b-19f2-4b15-8425-82fe8d0b0c77', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:02 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:02 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:02 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:02 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:02 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Getting quotas for project 4ebbe37ffda44c76a78244b3928f809b. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Getting quotas for user 31621d02dc5143689c0d8c1280479fdc and project 4ebbe37ffda44c76a78244b3928f809b. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:03 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:03 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-dc9260c5-323b-4676-a3ef-72b72fbc415d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.564018 Apr 24 00:11:03 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:11:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:11:03 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-56cb4b66-16cd-4e66-9085-2a36abae4d84 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:03 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-56cb4b66-16cd-4e66-9085-2a36abae4d84 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:03 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-56cb4b66-16cd-4e66-9085-2a36abae4d84 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31621d02dc5143689c0d8c1280479fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebbe37ffda44c76a78244b3928f809b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:03 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-56cb4b66-16cd-4e66-9085-2a36abae4d84 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7" status: 200 len: 1207 microversion: 2.1 time: 0.145095 Apr 24 00:11:03 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:03 2023] GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7 => generated 1207 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:06 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-39ed29f4-e04e-4851-9572-cead447de6d3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Action: 'create', calling method: .version_select at 0x7fc8c4471750>, body: {"keypair": {"name": "tempest-keypair-1814203803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCP71ilDAgiarKoZWp2VpgncCzSb29zFpexe4Gow4OMeIBbuSeM19Qy9FpbyZ23mx7wcJNC4TUUIImLZa0Jkxw/4VzByhN1LXhR6rqRIHWomLMjZmJ53RbDWMdufdl+oQ=="}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:06 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-39ed29f4-e04e-4851-9572-cead447de6d3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:06 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-39ed29f4-e04e-4851-9572-cead447de6d3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for user 471d341199f0431a95ae54651c4f0780 and project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:06 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-39ed29f4-e04e-4851-9572-cead447de6d3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157449 Apr 24 00:11:06 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:11:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce8722e-982a-458a-9efb-59d08a5717c7", "tag": "caba6f96-07db-411c-a38b-86be3bb1c71a"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:11 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Creating event network-changed:caba6f96-07db-411c-a38b-86be3bb1c71a for instance dce8722e-982a-458a-9efb-59d08a5717c7 on user Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61491) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bf9a1031-7c45-472c-af2c-24b0421e6853 req-c9632da0-3789-4e13-858a-5ea4889b0adc service nova] Acquired lock "compute-rpcapi-router" {{(pid=61491) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:11 user devstack@n-api.service[61491]: INFO nova.compute.rpcapi [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 24 00:11:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] Releasing lock "compute-rpcapi-router" {{(pid=61491) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 24 00:11:11 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-762028e5-c04a-447d-a2b8-92ec029c7e58 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307427 Apr 24 00:11:11 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 19/57] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:13 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1695303135", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c29459b8-bcaa-41ae-94fa-d61344bae22f"}], "security_groups": [{"name": "tempest-securitygroup--865863702"}], "key_name": "tempest-keypair-1814203803", "user_data": "}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:13 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:13 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:14 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] validate_networks() for [('c29459b8-bcaa-41ae-94fa-d61344bae22f', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for user 471d341199f0431a95ae54651c4f0780 and project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:16 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-b74c7229-9d28-463a-956f-273cb6996b53 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 3.177054 Apr 24 00:11:17 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:11:13 2023] POST /compute/v2.1/servers => generated 399 bytes in 3179 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:11:17 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-73e326ac-6650-48c0-8a3d-40b09374c9f6 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:17 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-73e326ac-6650-48c0-8a3d-40b09374c9f6 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:17 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:17 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:17 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-73e326ac-6650-48c0-8a3d-40b09374c9f6 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471d341199f0431a95ae54651c4f0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d063c2bdc884fb8b826b9fb6fd97405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:17 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-73e326ac-6650-48c0-8a3d-40b09374c9f6 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 200 len: 1232 microversion: 2.1 time: 0.213483 Apr 24 00:11:17 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:17 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 1232 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:17 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:17 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-1e5a107e-4af2-4c07-8ff5-afef5b96fda6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Action: 'create', calling method: .version_select at 0x7fc8c44c71c0>, body: {"keypair": {"name": "tempest-keypair-573827894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/KzlzjtqauDBrnzunF6cUjlci7dQJPS3JVA4rtGDgOFyp/2HY51uowvViM2HhE4lJZuUeHsvbKt1HzFUPo9qtzdZ2uB0Xr7EHNKxzFBZkrBwvigyr3VT3tKQN0UGAShA=="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:17 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-1e5a107e-4af2-4c07-8ff5-afef5b96fda6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for project e2bf3154181247f8963be8cd31399851. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:17 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-1e5a107e-4af2-4c07-8ff5-afef5b96fda6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for user 539997e65f4f4ef7998a4386d19a5e9f and project e2bf3154181247f8963be8cd31399851. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:17 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-1e5a107e-4af2-4c07-8ff5-afef5b96fda6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.401629 Apr 24 00:11:17 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 20/60] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 24 00:11:17 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 404 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 24 00:11:17 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-437284520", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "431c37bf-e6d7-4aa7-9081-a8c7bb5d5f3c"}]}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:17 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] validate_networks() for [('431c37bf-e6d7-4aa7-9081-a8c7bb5d5f3c', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce8722e-982a-458a-9efb-59d08a5717c7", "name": "network-vif-plugged", "status": "completed", "tag": "caba6f96-07db-411c-a38b-86be3bb1c71a"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Creating event network-vif-plugged:caba6f96-07db-411c-a38b-86be3bb1c71a for instance dce8722e-982a-458a-9efb-59d08a5717c7 on user Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61493) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-6241e159-5ec0-4f10-8e56-bd7c612f0c87 req-5e024613-fc34-4b1b-8d26-a947682ef00c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61493) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:18 user devstack@n-api.service[61493]: INFO nova.compute.rpcapi [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 24 00:11:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] Releasing lock "compute-rpcapi-router" {{(pid=61493) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 24 00:11:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-ba3ca607-6aad-43fa-aca9-0773aa8cae45 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103251 Apr 24 00:11:18 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 22/61] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Getting quotas for project 218aba2df07b4afaa999399d0981e6bf. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Getting quotas for user 9cf55386d2654a1e86af6882a2aed860 and project 218aba2df07b4afaa999399d0981e6bf. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:19 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8dca2f8d-75fa-44e1-b2b1-bce91aed6ae4 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.821795 Apr 24 00:11:19 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 20/62] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:11:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:11:19 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-e4b8549b-9275-4159-8d63-bb355da9636c tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:19 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-e4b8549b-9275-4159-8d63-bb355da9636c tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:19 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-e4b8549b-9275-4159-8d63-bb355da9636c tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf55386d2654a1e86af6882a2aed860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218aba2df07b4afaa999399d0981e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:19 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-e4b8549b-9275-4159-8d63-bb355da9636c tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d" status: 200 len: 1208 microversion: 2.1 time: 0.179291 Apr 24 00:11:19 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:19 2023] GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d => generated 1208 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:20 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109140451", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "2b9edd97-2af0-4b09-993c-95cc2b427fd8"}]}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:20 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] validate_networks() for [('2b9edd97-2af0-4b09-993c-95cc2b427fd8', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce8722e-982a-458a-9efb-59d08a5717c7", "name": "network-vif-plugged", "status": "completed", "tag": "caba6f96-07db-411c-a38b-86be3bb1c71a"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:20 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Creating event network-vif-plugged:caba6f96-07db-411c-a38b-86be3bb1c71a for instance dce8722e-982a-458a-9efb-59d08a5717c7 on user Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61492) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0d8f23ce-d311-4b4f-a69a-664c32644a6e req-1fc19b33-c37a-428b-8732-fbde14bcca85 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61492) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:20 user devstack@n-api.service[61492]: INFO nova.compute.rpcapi [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 24 00:11:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=61492) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 24 00:11:20 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8adc5202-01f8-4dfe-b1e8-84383b7813f3 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131874 Apr 24 00:11:20 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Getting quotas for project ce75f63fc0904eceb03e8319bddba4d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Getting quotas for user abae98323deb44dea0622186485cc7af and project ce75f63fc0904eceb03e8319bddba4d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:21 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-398c0f12-a93a-47b1-9e73-b31b857c5a44 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.968501 Apr 24 00:11:21 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 23/65] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:11:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:11:21 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-31915734-2004-40ec-85b5-85d3fbd6abd1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:21 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-31915734-2004-40ec-85b5-85d3fbd6abd1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:21 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:21 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:22 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-31915734-2004-40ec-85b5-85d3fbd6abd1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:22 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-31915734-2004-40ec-85b5-85d3fbd6abd1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1210 microversion: 2.1 time: 0.194454 Apr 24 00:11:22 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:21 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1210 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:22 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-952005257", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e09e353d-220c-429c-9767-a11a59bbf99a"}], "security_groups": [{"name": "tempest-securitygroup--1867096128"}], "key_name": "tempest-keypair-573827894", "user_data": "}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:22 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] validate_networks() for [('e09e353d-220c-429c-9767-a11a59bbf99a', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for project e2bf3154181247f8963be8cd31399851. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for user 539997e65f4f4ef7998a4386d19a5e9f and project e2bf3154181247f8963be8cd31399851. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:24 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:24 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-3b98375f-a1ac-48a9-9068-b667063f2734 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.675635 Apr 24 00:11:24 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 22/67] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 24 00:11:22 2023] POST /compute/v2.1/servers => generated 400 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 24 00:11:24 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3aea356e-ff21-4a80-a4e6-b3d5a06aed1d tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:24 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-3aea356e-ff21-4a80-a4e6-b3d5a06aed1d tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:24 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-3aea356e-ff21-4a80-a4e6-b3d5a06aed1d tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:24 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-3aea356e-ff21-4a80-a4e6-b3d5a06aed1d tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:24 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-3aea356e-ff21-4a80-a4e6-b3d5a06aed1d tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:24 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3aea356e-ff21-4a80-a4e6-b3d5a06aed1d tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 200 len: 1274 microversion: 2.20 time: 0.134495 Apr 24 00:11:24 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 24/68] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:11:24 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:11:24 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1137356929", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461"}]}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:24 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] validate_networks() for [('52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:26 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-f787d755-cbac-4490-b486-5ed0a739f7e9 req-fddc10d7-7d44-4c57-8806-7d9149fe8d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:26 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f787d755-cbac-4490-b486-5ed0a739f7e9 req-fddc10d7-7d44-4c57-8806-7d9149fe8d30 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:26 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f787d755-cbac-4490-b486-5ed0a739f7e9 req-fddc10d7-7d44-4c57-8806-7d9149fe8d30 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:26 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f787d755-cbac-4490-b486-5ed0a739f7e9 req-fddc10d7-7d44-4c57-8806-7d9149fe8d30 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:26 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-f787d755-cbac-4490-b486-5ed0a739f7e9 req-fddc10d7-7d44-4c57-8806-7d9149fe8d30 service nova] Creating event network-changed:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:11:26 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-f787d755-cbac-4490-b486-5ed0a739f7e9 req-fddc10d7-7d44-4c57-8806-7d9149fe8d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056472 Apr 24 00:11:26 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for user 8d0ab07106dd4995aa7e3f5b6bc70e56 and project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:26 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:26 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-27c2118c-033b-4842-b090-af2c77b3c2fb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.146103 Apr 24 00:11:26 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 23/70] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 24 00:11:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 24 00:11:26 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-01d93101-94e9-4462-a4ab-45b927e88ca8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:26 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-01d93101-94e9-4462-a4ab-45b927e88ca8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:26 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-01d93101-94e9-4462-a4ab-45b927e88ca8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:26 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-01d93101-94e9-4462-a4ab-45b927e88ca8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:26 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-01d93101-94e9-4462-a4ab-45b927e88ca8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:26 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-01d93101-94e9-4462-a4ab-45b927e88ca8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b" status: 200 len: 1395 microversion: 2.87 time: 0.261385 Apr 24 00:11:26 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:11:26 2023] GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b => generated 1395 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:11:28 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-fb6f8e56-a841-4bd2-bb76-6a12a4205803 req-e1cfde75-4ca4-4f79-b22c-d072821f80d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-fb6f8e56-a841-4bd2-bb76-6a12a4205803 req-e1cfde75-4ca4-4f79-b22c-d072821f80d6 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-fb6f8e56-a841-4bd2-bb76-6a12a4205803 req-e1cfde75-4ca4-4f79-b22c-d072821f80d6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-fb6f8e56-a841-4bd2-bb76-6a12a4205803 req-e1cfde75-4ca4-4f79-b22c-d072821f80d6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:28 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-fb6f8e56-a841-4bd2-bb76-6a12a4205803 req-e1cfde75-4ca4-4f79-b22c-d072821f80d6 service nova] Creating event network-changed:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:11:28 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-fb6f8e56-a841-4bd2-bb76-6a12a4205803 req-e1cfde75-4ca4-4f79-b22c-d072821f80d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125504 Apr 24 00:11:28 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:29 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-31f698ef-364c-4709-b077-41f752094bd1 req-9d9688b2-7f9c-4137-9f8e-113595664605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:29 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-31f698ef-364c-4709-b077-41f752094bd1 req-9d9688b2-7f9c-4137-9f8e-113595664605 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:29 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-31f698ef-364c-4709-b077-41f752094bd1 req-9d9688b2-7f9c-4137-9f8e-113595664605 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:29 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-31f698ef-364c-4709-b077-41f752094bd1 req-9d9688b2-7f9c-4137-9f8e-113595664605 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:29 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-31f698ef-364c-4709-b077-41f752094bd1 req-9d9688b2-7f9c-4137-9f8e-113595664605 service nova] Creating event network-changed:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:11:29 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-31f698ef-364c-4709-b077-41f752094bd1 req-9d9688b2-7f9c-4137-9f8e-113595664605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064433 Apr 24 00:11:29 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:30 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "name": "network-vif-plugged", "status": "completed", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}, {"name": "network-changed", "server_uuid": "ce19423d-a6ee-4506-9cd1-ec4803abdd86", "tag": "f6c98734-17ee-42d0-9372-fd76526b0b27"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:30 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:30 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:30 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:30 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] Creating event network-vif-plugged:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:11:30 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] Creating event network-changed:f6c98734-17ee-42d0-9372-fd76526b0b27 for instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 on user Apr 24 00:11:30 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-c36bdc29-daa4-404e-8d29-6dbc25ef5aba req-2bc398fa-31a6-4806-b6fa-e42f1bcb0085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058883 Apr 24 00:11:30 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 26/74] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:32 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-c98a3cb3-6f32-410e-babf-bb962886585f req-11bfa404-cccc-40a2-85df-d2eee54b6cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-plugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c98a3cb3-6f32-410e-babf-bb962886585f req-11bfa404-cccc-40a2-85df-d2eee54b6cdc service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c98a3cb3-6f32-410e-babf-bb962886585f req-11bfa404-cccc-40a2-85df-d2eee54b6cdc service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c98a3cb3-6f32-410e-babf-bb962886585f req-11bfa404-cccc-40a2-85df-d2eee54b6cdc service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:32 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-c98a3cb3-6f32-410e-babf-bb962886585f req-11bfa404-cccc-40a2-85df-d2eee54b6cdc service nova] Creating event network-vif-plugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:11:32 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-c98a3cb3-6f32-410e-babf-bb962886585f req-11bfa404-cccc-40a2-85df-d2eee54b6cdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053599 Apr 24 00:11:32 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:32 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-53e803cc-a556-4097-a68c-e0e4fe70ab24 req-9173f84d-2465-4799-b979-760f022606de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "name": "network-vif-plugged", "status": "completed", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:32 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:32 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-53e803cc-a556-4097-a68c-e0e4fe70ab24 req-9173f84d-2465-4799-b979-760f022606de service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:32 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-53e803cc-a556-4097-a68c-e0e4fe70ab24 req-9173f84d-2465-4799-b979-760f022606de service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:32 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-53e803cc-a556-4097-a68c-e0e4fe70ab24 req-9173f84d-2465-4799-b979-760f022606de service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:32 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-53e803cc-a556-4097-a68c-e0e4fe70ab24 req-9173f84d-2465-4799-b979-760f022606de service nova] Creating event network-vif-plugged:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:11:32 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-53e803cc-a556-4097-a68c-e0e4fe70ab24 req-9173f84d-2465-4799-b979-760f022606de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054379 Apr 24 00:11:32 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:34 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:34 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-ad41b5ab-3f7e-4c17-8d94-bf4171b8a86c req-0d248583-19dc-4755-abd3-be36caa502f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-plugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:34 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ad41b5ab-3f7e-4c17-8d94-bf4171b8a86c req-0d248583-19dc-4755-abd3-be36caa502f5 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:34 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ad41b5ab-3f7e-4c17-8d94-bf4171b8a86c req-0d248583-19dc-4755-abd3-be36caa502f5 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:34 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ad41b5ab-3f7e-4c17-8d94-bf4171b8a86c req-0d248583-19dc-4755-abd3-be36caa502f5 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:34 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-ad41b5ab-3f7e-4c17-8d94-bf4171b8a86c req-0d248583-19dc-4755-abd3-be36caa502f5 service nova] Creating event network-vif-plugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:11:34 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-ad41b5ab-3f7e-4c17-8d94-bf4171b8a86c req-0d248583-19dc-4755-abd3-be36caa502f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038886 Apr 24 00:11:34 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:35 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=8 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:35 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=18 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:35 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-da02cd48-8d5d-4179-8fe5-886bc329445e req-24a251e2-a64c-4f79-984d-2a24bbbeee22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b", "tag": "7a3b1d96-2c84-4994-b698-c59fb56c44f8"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:35 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-da02cd48-8d5d-4179-8fe5-886bc329445e req-24a251e2-a64c-4f79-984d-2a24bbbeee22 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:35 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-da02cd48-8d5d-4179-8fe5-886bc329445e req-24a251e2-a64c-4f79-984d-2a24bbbeee22 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:35 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-da02cd48-8d5d-4179-8fe5-886bc329445e req-24a251e2-a64c-4f79-984d-2a24bbbeee22 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:35 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-da02cd48-8d5d-4179-8fe5-886bc329445e req-24a251e2-a64c-4f79-984d-2a24bbbeee22 service nova] Creating event network-changed:7a3b1d96-2c84-4994-b698-c59fb56c44f8 for instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b on user Apr 24 00:11:35 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-da02cd48-8d5d-4179-8fe5-886bc329445e req-24a251e2-a64c-4f79-984d-2a24bbbeee22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172192 Apr 24 00:11:35 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "name": "network-vif-plugged", "status": "completed", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}, {"server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "name": "network-vif-plugged", "status": "completed", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] Creating event network-vif-plugged:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:11:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] Creating event network-vif-plugged:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:11:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-fa79a7b0-9332-4ab4-bd5e-ec4c2224d4c4 req-538657c3-35b5-490d-b765-422cd2843ad0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101157 Apr 24 00:11:36 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:38 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=12 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:38 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce19423d-a6ee-4506-9cd1-ec4803abdd86", "name": "network-vif-plugged", "status": "completed", "tag": "f6c98734-17ee-42d0-9372-fd76526b0b27"}, {"server_uuid": "ce19423d-a6ee-4506-9cd1-ec4803abdd86", "name": "network-vif-plugged", "status": "completed", "tag": "f6c98734-17ee-42d0-9372-fd76526b0b27"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:38 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3f6a4045-99a0-426a-9c7f-cc50ebd5cc01 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Action: 'create', calling method: .version_select at 0x7fc8c43cf6d0>, body: {"keypair": {"name": "tempest-keypair-324105185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS1AjVipKW5cEt2rl35m09NWv1oXpefnHcFJOdwsnsIp5JPDa2HbS1qzIbePN1In3l/JpDLeRBWNBZrjWWOmQw0RrMjdQbQyn62Y/HmMBLXcgD+X7ygv99DAQ58UKkQKw=="}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:38 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-3f6a4045-99a0-426a-9c7f-cc50ebd5cc01 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Getting quotas for project df0187dbb10d42da941645107df203f6. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:38 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-3f6a4045-99a0-426a-9c7f-cc50ebd5cc01 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Getting quotas for user 640ec20e46a2422a8aabcc152e522e02 and project df0187dbb10d42da941645107df203f6. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] Creating event network-vif-plugged:f6c98734-17ee-42d0-9372-fd76526b0b27 for instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 on user Apr 24 00:11:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] Creating event network-vif-plugged:f6c98734-17ee-42d0-9372-fd76526b0b27 for instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 on user Apr 24 00:11:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-bdd48bd3-a77d-442e-a407-78312631bbfd req-5e8e1b2e-a19d-48d2-9ccc-303991589f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083543 Apr 24 00:11:38 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:38 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3f6a4045-99a0-426a-9c7f-cc50ebd5cc01 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.491849 Apr 24 00:11:38 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 28/81] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:11:38 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:41 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:41 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=14 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:41 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-af7534d2-b327-40f1-80e2-e2e1a32757aa req-0cf7283e-d93e-41c1-9ccf-fbc78d4d4cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b", "name": "network-vif-plugged", "status": "completed", "tag": "7a3b1d96-2c84-4994-b698-c59fb56c44f8"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-af7534d2-b327-40f1-80e2-e2e1a32757aa req-0cf7283e-d93e-41c1-9ccf-fbc78d4d4cb2 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-af7534d2-b327-40f1-80e2-e2e1a32757aa req-0cf7283e-d93e-41c1-9ccf-fbc78d4d4cb2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-af7534d2-b327-40f1-80e2-e2e1a32757aa req-0cf7283e-d93e-41c1-9ccf-fbc78d4d4cb2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:41 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-af7534d2-b327-40f1-80e2-e2e1a32757aa req-0cf7283e-d93e-41c1-9ccf-fbc78d4d4cb2 service nova] Creating event network-vif-plugged:7a3b1d96-2c84-4994-b698-c59fb56c44f8 for instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b on user Apr 24 00:11:41 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-af7534d2-b327-40f1-80e2-e2e1a32757aa req-0cf7283e-d93e-41c1-9ccf-fbc78d4d4cb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087046 Apr 24 00:11:41 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:44 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-f6a6fb5b-5721-468b-a22f-49071f6852d6 req-347e9524-6366-40fb-b1c8-151d0d2f97be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b", "name": "network-vif-plugged", "status": "completed", "tag": "7a3b1d96-2c84-4994-b698-c59fb56c44f8"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:44 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=9 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:44 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f6a6fb5b-5721-468b-a22f-49071f6852d6 req-347e9524-6366-40fb-b1c8-151d0d2f97be service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:44 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f6a6fb5b-5721-468b-a22f-49071f6852d6 req-347e9524-6366-40fb-b1c8-151d0d2f97be service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:44 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f6a6fb5b-5721-468b-a22f-49071f6852d6 req-347e9524-6366-40fb-b1c8-151d0d2f97be service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:44 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=21 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:44 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-f6a6fb5b-5721-468b-a22f-49071f6852d6 req-347e9524-6366-40fb-b1c8-151d0d2f97be service nova] Creating event network-vif-plugged:7a3b1d96-2c84-4994-b698-c59fb56c44f8 for instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b on user Apr 24 00:11:44 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-f6a6fb5b-5721-468b-a22f-49071f6852d6 req-347e9524-6366-40fb-b1c8-151d0d2f97be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105200 Apr 24 00:11:44 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:45 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-624022111", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "fc4a840b-9c4f-4c52-8a4e-411d66ac14e1"}], "security_groups": [{"name": "tempest-securitygroup--1069907502"}], "key_name": "tempest-keypair-324105185", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:45 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=10 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:45 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] validate_networks() for [('fc4a840b-9c4f-4c52-8a4e-411d66ac14e1', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a5e55237-818e-4077-aaa2-3770fa281497 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3b2bac0>, body: {"keypair": {"name": "tempest-keypair-1524659291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/vhtnDrSUbhDcnzbj2hTMPnSPvEi9MH767Q1zBuBu7Q388dTCb4/K/XteUMBOM3VV8UZ23HJ9k+WdLhWp/wu0OUK0FLVdByp/HDgDXNkveo1WfqdtyNUzgJX99Y7XXPw=="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Getting quotas for project df0187dbb10d42da941645107df203f6. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Getting quotas for user 640ec20e46a2422a8aabcc152e522e02 and project df0187dbb10d42da941645107df203f6. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:46 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:46 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-a5e55237-818e-4077-aaa2-3770fa281497 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Getting quotas for project 6e163039cafd4b2880a41ded2e2f7d00. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:46 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-a5e55237-818e-4077-aaa2-3770fa281497 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Getting quotas for user 04625ea29ba641fc8342441f61274d4f and project 6e163039cafd4b2880a41ded2e2f7d00. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-a5e55237-818e-4077-aaa2-3770fa281497 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.248544 Apr 24 00:11:46 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:11:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:46 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-7762c2c0-4661-4f90-a7f7-06bb271cb6ed tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.129504 Apr 24 00:11:46 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:11:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:11:46 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-57dc97c8-0586-42fd-b7df-c51426ac8283 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:46 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-57dc97c8-0586-42fd-b7df-c51426ac8283 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:46 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-57dc97c8-0586-42fd-b7df-c51426ac8283 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640ec20e46a2422a8aabcc152e522e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0187dbb10d42da941645107df203f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:46 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-57dc97c8-0586-42fd-b7df-c51426ac8283 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d" status: 200 len: 1234 microversion: 2.1 time: 0.164654 Apr 24 00:11:46 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 29/86] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:46 2023] GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d => generated 1234 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:50 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1292260913", "imageRef": "6d0fc2e0-41f4-457d-aa83-7dd6fd114687", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "60f29626-4198-42e4-835f-2d0d9cfabf8d"}], "security_groups": [{"name": "tempest-securitygroup--1285617159"}], "key_name": "tempest-keypair-1524659291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:50 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] validate_networks() for [('60f29626-4198-42e4-835f-2d0d9cfabf8d', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=10 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Getting quotas for project 6e163039cafd4b2880a41ded2e2f7d00. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Getting quotas for user 04625ea29ba641fc8342441f61274d4f and project 6e163039cafd4b2880a41ded2e2f7d00. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:11:51 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6d0fc2e0-41f4-457d-aa83-7dd6fd114687',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:11:52 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-5a03ce46-d61a-42ad-9986-c4931699b3df tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.536480 Apr 24 00:11:52 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:11:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:11:52 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-2b33c603-37b1-4ae3-9083-2001de2866a1 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:52 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-2b33c603-37b1-4ae3-9083-2001de2866a1 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:52 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:52 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-5c21f88b-6e2a-4997-a08a-f90868b64c4f req-86e169e0-4de0-42fc-a0fc-0adef6859759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:52 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2b33c603-37b1-4ae3-9083-2001de2866a1 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04625ea29ba641fc8342441f61274d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e163039cafd4b2880a41ded2e2f7d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:52 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-2b33c603-37b1-4ae3-9083-2001de2866a1 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 200 len: 1240 microversion: 2.1 time: 0.120837 Apr 24 00:11:52 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 30/88] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:52 2023] GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-5c21f88b-6e2a-4997-a08a-f90868b64c4f req-86e169e0-4de0-42fc-a0fc-0adef6859759 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-5c21f88b-6e2a-4997-a08a-f90868b64c4f req-86e169e0-4de0-42fc-a0fc-0adef6859759 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-5c21f88b-6e2a-4997-a08a-f90868b64c4f req-86e169e0-4de0-42fc-a0fc-0adef6859759 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:52 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-5c21f88b-6e2a-4997-a08a-f90868b64c4f req-86e169e0-4de0-42fc-a0fc-0adef6859759 service nova] Creating event network-changed:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:11:52 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-5c21f88b-6e2a-4997-a08a-f90868b64c4f req-86e169e0-4de0-42fc-a0fc-0adef6859759 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107150 Apr 24 00:11:52 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:53 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:54 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31621d02dc5143689c0d8c1280479fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebbe37ffda44c76a78244b3928f809b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:11:54 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-97adc4ee-d997-4f14-93b6-12bd3773835d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7" status: 200 len: 1484 microversion: 2.1 time: 0.709515 Apr 24 00:11:54 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:11:53 2023] GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7 => generated 1484 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:11:54 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-a190cd02-3bf5-4f48-9b4a-1b11727bd82f req-7c20dae5-65ee-4645-9e64-ab39746795f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "name": "network-vif-plugged", "status": "completed", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:54 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-a190cd02-3bf5-4f48-9b4a-1b11727bd82f req-7c20dae5-65ee-4645-9e64-ab39746795f0 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:54 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-a190cd02-3bf5-4f48-9b4a-1b11727bd82f req-7c20dae5-65ee-4645-9e64-ab39746795f0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:54 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-a190cd02-3bf5-4f48-9b4a-1b11727bd82f req-7c20dae5-65ee-4645-9e64-ab39746795f0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-a190cd02-3bf5-4f48-9b4a-1b11727bd82f req-7c20dae5-65ee-4645-9e64-ab39746795f0 service nova] Creating event network-vif-plugged:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:11:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-a190cd02-3bf5-4f48-9b4a-1b11727bd82f req-7c20dae5-65ee-4645-9e64-ab39746795f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052988 Apr 24 00:11:54 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:55 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-f1c74533-bae0-4ba6-a55c-a09af34fbce4 req-3a7190ba-fb51-4f3e-8613-d5b46cb9d094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f1c74533-bae0-4ba6-a55c-a09af34fbce4 req-3a7190ba-fb51-4f3e-8613-d5b46cb9d094 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f1c74533-bae0-4ba6-a55c-a09af34fbce4 req-3a7190ba-fb51-4f3e-8613-d5b46cb9d094 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f1c74533-bae0-4ba6-a55c-a09af34fbce4 req-3a7190ba-fb51-4f3e-8613-d5b46cb9d094 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-f1c74533-bae0-4ba6-a55c-a09af34fbce4 req-3a7190ba-fb51-4f3e-8613-d5b46cb9d094 service nova] Creating event network-changed:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:11:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-f1c74533-bae0-4ba6-a55c-a09af34fbce4 req-3a7190ba-fb51-4f3e-8613-d5b46cb9d094 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035499 Apr 24 00:11:56 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-4550e69c-213f-4487-8695-925fa6ca820f req-8b93397c-8d2f-401d-8333-38b121ef2917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "name": "network-vif-plugged", "status": "completed", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-4550e69c-213f-4487-8695-925fa6ca820f req-8b93397c-8d2f-401d-8333-38b121ef2917 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-4550e69c-213f-4487-8695-925fa6ca820f req-8b93397c-8d2f-401d-8333-38b121ef2917 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-4550e69c-213f-4487-8695-925fa6ca820f req-8b93397c-8d2f-401d-8333-38b121ef2917 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-4550e69c-213f-4487-8695-925fa6ca820f req-8b93397c-8d2f-401d-8333-38b121ef2917 service nova] Creating event network-vif-plugged:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:11:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-4550e69c-213f-4487-8695-925fa6ca820f req-8b93397c-8d2f-401d-8333-38b121ef2917 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055572 Apr 24 00:11:57 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:11:58 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:11:58 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-2c227097-ebfa-45f5-b825-b1eab03acc12 req-eaa44602-55dd-4bf3-82f2-7fbd78b863f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "name": "network-vif-plugged", "status": "completed", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:11:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-2c227097-ebfa-45f5-b825-b1eab03acc12 req-eaa44602-55dd-4bf3-82f2-7fbd78b863f8 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:11:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-2c227097-ebfa-45f5-b825-b1eab03acc12 req-eaa44602-55dd-4bf3-82f2-7fbd78b863f8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:11:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-2c227097-ebfa-45f5-b825-b1eab03acc12 req-eaa44602-55dd-4bf3-82f2-7fbd78b863f8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:11:58 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-2c227097-ebfa-45f5-b825-b1eab03acc12 req-eaa44602-55dd-4bf3-82f2-7fbd78b863f8 service nova] Creating event network-vif-plugged:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:11:58 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-2c227097-ebfa-45f5-b825-b1eab03acc12 req-eaa44602-55dd-4bf3-82f2-7fbd78b863f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053300 Apr 24 00:11:58 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:00 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:00 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-0c3e867b-847c-4fad-806e-c16a969ba401 req-0501d3de-d7da-4b41-9d30-b6626faab8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "name": "network-vif-plugged", "status": "completed", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0c3e867b-847c-4fad-806e-c16a969ba401 req-0501d3de-d7da-4b41-9d30-b6626faab8f4 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0c3e867b-847c-4fad-806e-c16a969ba401 req-0501d3de-d7da-4b41-9d30-b6626faab8f4 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0c3e867b-847c-4fad-806e-c16a969ba401 req-0501d3de-d7da-4b41-9d30-b6626faab8f4 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-0c3e867b-847c-4fad-806e-c16a969ba401 req-0501d3de-d7da-4b41-9d30-b6626faab8f4 service nova] Creating event network-vif-plugged:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:12:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-0c3e867b-847c-4fad-806e-c16a969ba401 req-0501d3de-d7da-4b41-9d30-b6626faab8f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067715 Apr 24 00:12:00 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 24 00:12:02 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:02 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=10 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-54566a19-e2b5-4f56-8059-782a6df4f272 tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3b60280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1646099812"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:02 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-54566a19-e2b5-4f56-8059-782a6df4f272 tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.669031 Apr 24 00:12:02 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 32/96] 10.0.0.210 () {64 vars in 1232 bytes} [Mon Apr 24 00:12:02 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 671 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 24 00:12:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=12 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c69a1253-35c8-46c5-9c51-1dc4f38bb6ff tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Calling method '.version_select at 0x7fc8c43cdab0>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:03 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-c69a1253-35c8-46c5-9c51-1dc4f38bb6ff tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916" status: 200 len: 342 microversion: 2.1 time: 0.081333 Apr 24 00:12:03 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 33/97] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:12:02 2023] GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916 => generated 342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:04 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1c20f861-a057-47b4-bf2b-9d6a9bf8f679 tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Calling method '.version_select at 0x7fc8c43c6e60>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:04 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-1c20f861-a057-47b4-bf2b-9d6a9bf8f679 tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916" status: 200 len: 342 microversion: 2.1 time: 0.067716 Apr 24 00:12:04 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 33/98] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:12:04 2023] GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916 => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:04 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-3adf55a0-496e-48ce-82d9-420b54a221f7 tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Calling method '.version_select at 0x7fc8c3a643a0>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:04 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-3adf55a0-496e-48ce-82d9-420b54a221f7 tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916" status: 202 len: 0 microversion: 2.1 time: 0.145495 Apr 24 00:12:04 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:12:04 2023] DELETE /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:12:04 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-dc598003-dc65-4923-a2cf-c26a37bf268b tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Calling method '.version_select at 0x7fc8c43ce170>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:04 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-dc598003-dc65-4923-a2cf-c26a37bf268b tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] HTTP exception thrown: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. Apr 24 00:12:04 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-dc598003-dc65-4923-a2cf-c26a37bf268b tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Request method failure captured: Apr 24 00:12:04 user devstack@n-api.service[61493]: request: GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916 HTTP/1.1 Apr 24 00:12:04 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:12:04 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:12:04 user devstack@n-api.service[61493]: Connection: close Apr 24 00:12:04 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:12:04 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:12:04 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:12:04 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:12:04 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRclSlG4_lGdDvNVDSeDzwleg5nh0vOwtTzXwuEA-09uC1K_Hkdo3kgT2r-9oWMIcKw1ZPdMaqKIps0LGUhRF2qyioixlDXz25gxckkmRp_osd87Ya679Wfvv1awvNuY8LItFakLogH-P1We9NXj5VD9fUkg4xgBgRS3LEFpWNbUZJM8 Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Project-Id: 54cb4db557b54ba19b608c31762fbe1a Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1744001970 Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54cb4db557b54ba19b608c31762fbe1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54cb4db557b54ba19b608c31762fbe1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54cb4db557b54ba19b608c31762fbe1a"}]}] Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1744001970 Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Tenant-Id: 54cb4db557b54ba19b608c31762fbe1a Apr 24 00:12:04 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1744001970 Apr 24 00:12:04 user devstack@n-api.service[61493]: X-User: tempest-VolumesSnapshotsTestJSON-1744001970-project-member Apr 24 00:12:04 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:12:04 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:12:04 user devstack@n-api.service[61493]: X-User-Id: 5f468989e4d7458f93b8d5a118a26048 Apr 24 00:12:04 user devstack@n-api.service[61493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1744001970-project-member Apr 24 00:12:04 user devstack@n-api.service[61493]: method: Apr 24 00:12:04 user devstack@n-api.service[61493]: exception: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. Apr 24 00:12:04 user devstack@n-api.service[61493]: action_args: {'id': '308e337a-746d-4aa4-b732-4c46246a8916'} Apr 24 00:12:04 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. (HTTP 404) (Request-ID: req-042e8deb-b058-4c3a-973b-e66242a46090) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. Apr 24 00:12:04 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:12:04 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-dc598003-dc65-4923-a2cf-c26a37bf268b tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] Returning 404 to user: Volume 308e337a-746d-4aa4-b732-4c46246a8916 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:12:04 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-dc598003-dc65-4923-a2cf-c26a37bf268b tempest-VolumesSnapshotsTestJSON-1744001970 tempest-VolumesSnapshotsTestJSON-1744001970-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916" status: 404 len: 109 microversion: 2.1 time: 0.053723 Apr 24 00:12:04 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:12:04 2023] GET /compute/v2.1/os-volumes/308e337a-746d-4aa4-b732-4c46246a8916 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:08 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471d341199f0431a95ae54651c4f0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d063c2bdc884fb8b826b9fb6fd97405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-74da1294-be7d-4f5b-b361-e2b54e87fbaa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 200 len: 1537 microversion: 2.1 time: 0.746403 Apr 24 00:12:08 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 34/101] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:07 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 1537 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=10 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:09 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-891210301", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:09 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] validate_networks() for [('ba4ccc60-ffcd-4638-9c93-6d4d59641961', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=7 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:09 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf55386d2654a1e86af6882a2aed860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218aba2df07b4afaa999399d0981e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:09 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-06feb869-92fc-4a8a-a7fc-cdc3ccd55eb2 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d" status: 200 len: 1488 microversion: 2.1 time: 0.391206 Apr 24 00:12:09 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 35/102] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:09 2023] GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d => generated 1488 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Getting quotas for project 5cff0cbf3a5c4a4aadb3399a31adff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Getting quotas for user 514ecffec8034d60ae3c00ecd1ef5c8b and project 5cff0cbf3a5c4a4aadb3399a31adff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:12:10 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:12:10 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-a9bf7dd6-a1e5-4542-a146-92f9846b7bc5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.103910 Apr 24 00:12:10 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:12:09 2023] POST /compute/v2.1/servers => generated 381 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:12:10 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-aef333fb-aa54-4b72-80a3-dca33798b557 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:10 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-aef333fb-aa54-4b72-80a3-dca33798b557 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:10 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-aef333fb-aa54-4b72-80a3-dca33798b557 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:10 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-aef333fb-aa54-4b72-80a3-dca33798b557 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32" status: 200 len: 1215 microversion: 2.1 time: 0.086321 Apr 24 00:12:10 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:10 2023] GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:10 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-265518045", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:10 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] validate_networks() for [('ba4ccc60-ffcd-4638-9c93-6d4d59641961', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Getting quotas for project 5cff0cbf3a5c4a4aadb3399a31adff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Getting quotas for user 514ecffec8034d60ae3c00ecd1ef5c8b and project 5cff0cbf3a5c4a4aadb3399a31adff0d. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:12:11 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:12:11 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-53eea3bc-cb3e-4072-942f-8d3d7266ab25 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.754175 Apr 24 00:12:11 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 36/105] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:12:10 2023] POST /compute/v2.1/servers => generated 381 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:12:11 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-88b2ec1d-2c3d-4b67-a2e2-891e2bab5c3c tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:11 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-88b2ec1d-2c3d-4b67-a2e2-891e2bab5c3c tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:11 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-88b2ec1d-2c3d-4b67-a2e2-891e2bab5c3c tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:11 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-88b2ec1d-2c3d-4b67-a2e2-891e2bab5c3c tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 200 len: 1215 microversion: 2.1 time: 0.087525 Apr 24 00:12:11 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:11 2023] GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:12 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:12 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-cbb3bf4a-e26e-4a19-943c-9618dc77d2a7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1494 microversion: 2.1 time: 0.396772 Apr 24 00:12:12 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:12 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1494 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:13 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-08e0c9ea-c445-48a1-a48d-18527776ce5d req-1ce047e6-8feb-437f-9b11-6e9da362b71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac38bbc2-2229-4497-b501-e9230ec59a32", "tag": "b716ea04-c5e7-43fc-9f20-5ecb011d6385"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:13 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-08e0c9ea-c445-48a1-a48d-18527776ce5d req-1ce047e6-8feb-437f-9b11-6e9da362b71e service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:13 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-08e0c9ea-c445-48a1-a48d-18527776ce5d req-1ce047e6-8feb-437f-9b11-6e9da362b71e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:13 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-08e0c9ea-c445-48a1-a48d-18527776ce5d req-1ce047e6-8feb-437f-9b11-6e9da362b71e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:13 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-08e0c9ea-c445-48a1-a48d-18527776ce5d req-1ce047e6-8feb-437f-9b11-6e9da362b71e service nova] Creating event network-changed:b716ea04-c5e7-43fc-9f20-5ecb011d6385 for instance ac38bbc2-2229-4497-b501-e9230ec59a32 on user Apr 24 00:12:13 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-08e0c9ea-c445-48a1-a48d-18527776ce5d req-1ce047e6-8feb-437f-9b11-6e9da362b71e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042067 Apr 24 00:12:13 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-49c4dace-4c5e-4990-8b74-2445ce96d93e req-96b1b79e-df00-4186-a02d-7cc684a72bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-49c4dace-4c5e-4990-8b74-2445ce96d93e req-96b1b79e-df00-4186-a02d-7cc684a72bfa service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-49c4dace-4c5e-4990-8b74-2445ce96d93e req-96b1b79e-df00-4186-a02d-7cc684a72bfa service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-49c4dace-4c5e-4990-8b74-2445ce96d93e req-96b1b79e-df00-4186-a02d-7cc684a72bfa service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-49c4dace-4c5e-4990-8b74-2445ce96d93e req-96b1b79e-df00-4186-a02d-7cc684a72bfa service nova] Creating event network-changed:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:12:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-49c4dace-4c5e-4990-8b74-2445ce96d93e req-96b1b79e-df00-4186-a02d-7cc684a72bfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039377 Apr 24 00:12:14 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=20 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:14 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-13550076-bdb4-4862-8597-6503a3fbd034 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 200 len: 1586 microversion: 2.20 time: 0.267127 Apr 24 00:12:14 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 37/110] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:12:14 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 1586 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:12:15 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-eb7e43c1-ae23-4dbc-84a2-e240beb3fa87 req-308b830c-d8b1-435d-812e-8736beda8cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac38bbc2-2229-4497-b501-e9230ec59a32", "name": "network-vif-plugged", "status": "completed", "tag": "b716ea04-c5e7-43fc-9f20-5ecb011d6385"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-eb7e43c1-ae23-4dbc-84a2-e240beb3fa87 req-308b830c-d8b1-435d-812e-8736beda8cf8 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-eb7e43c1-ae23-4dbc-84a2-e240beb3fa87 req-308b830c-d8b1-435d-812e-8736beda8cf8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-eb7e43c1-ae23-4dbc-84a2-e240beb3fa87 req-308b830c-d8b1-435d-812e-8736beda8cf8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:15 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-eb7e43c1-ae23-4dbc-84a2-e240beb3fa87 req-308b830c-d8b1-435d-812e-8736beda8cf8 service nova] Creating event network-vif-plugged:b716ea04-c5e7-43fc-9f20-5ecb011d6385 for instance ac38bbc2-2229-4497-b501-e9230ec59a32 on user Apr 24 00:12:15 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-eb7e43c1-ae23-4dbc-84a2-e240beb3fa87 req-308b830c-d8b1-435d-812e-8736beda8cf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041420 Apr 24 00:12:15 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:17 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-d6be5273-5b5a-426a-88a6-6a220fcc4807 req-1b103b23-d02b-4e8d-8d29-da1886f561ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d6be5273-5b5a-426a-88a6-6a220fcc4807 req-1b103b23-d02b-4e8d-8d29-da1886f561ea service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d6be5273-5b5a-426a-88a6-6a220fcc4807 req-1b103b23-d02b-4e8d-8d29-da1886f561ea service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d6be5273-5b5a-426a-88a6-6a220fcc4807 req-1b103b23-d02b-4e8d-8d29-da1886f561ea service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:17 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=26 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-d6be5273-5b5a-426a-88a6-6a220fcc4807 req-1b103b23-d02b-4e8d-8d29-da1886f561ea service nova] Creating event network-vif-plugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:12:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-d6be5273-5b5a-426a-88a6-6a220fcc4807 req-1b103b23-d02b-4e8d-8d29-da1886f561ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045319 Apr 24 00:12:17 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:17 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:17 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-0907e8c8-e6d2-4411-8616-4cbc2a5268a8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b" status: 200 len: 1690 microversion: 2.87 time: 0.463818 Apr 24 00:12:17 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 37/113] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:12:17 2023] GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b => generated 1690 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:12:17 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-ff8ceb22-c374-483e-82d4-8889a00a8242 req-2f305c1c-636f-423a-a17d-e43ef4501b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac38bbc2-2229-4497-b501-e9230ec59a32", "name": "network-vif-plugged", "status": "completed", "tag": "b716ea04-c5e7-43fc-9f20-5ecb011d6385"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ff8ceb22-c374-483e-82d4-8889a00a8242 req-2f305c1c-636f-423a-a17d-e43ef4501b2c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ff8ceb22-c374-483e-82d4-8889a00a8242 req-2f305c1c-636f-423a-a17d-e43ef4501b2c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ff8ceb22-c374-483e-82d4-8889a00a8242 req-2f305c1c-636f-423a-a17d-e43ef4501b2c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-ff8ceb22-c374-483e-82d4-8889a00a8242 req-2f305c1c-636f-423a-a17d-e43ef4501b2c service nova] Creating event network-vif-plugged:b716ea04-c5e7-43fc-9f20-5ecb011d6385 for instance ac38bbc2-2229-4497-b501-e9230ec59a32 on user Apr 24 00:12:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-ff8ceb22-c374-483e-82d4-8889a00a8242 req-2f305c1c-636f-423a-a17d-e43ef4501b2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Apr 24 00:12:18 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:19 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-0eccbec9-02a9-4b9b-8dea-302cd96bcab2 req-1fe458b0-1a18-4747-aaa8-0d6b0682b873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0eccbec9-02a9-4b9b-8dea-302cd96bcab2 req-1fe458b0-1a18-4747-aaa8-0d6b0682b873 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0eccbec9-02a9-4b9b-8dea-302cd96bcab2 req-1fe458b0-1a18-4747-aaa8-0d6b0682b873 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0eccbec9-02a9-4b9b-8dea-302cd96bcab2 req-1fe458b0-1a18-4747-aaa8-0d6b0682b873 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-0eccbec9-02a9-4b9b-8dea-302cd96bcab2 req-1fe458b0-1a18-4747-aaa8-0d6b0682b873 service nova] Creating event network-vif-plugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:12:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-0eccbec9-02a9-4b9b-8dea-302cd96bcab2 req-1fe458b0-1a18-4747-aaa8-0d6b0682b873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030956 Apr 24 00:12:19 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=8 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=10 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:36 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640ec20e46a2422a8aabcc152e522e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0187dbb10d42da941645107df203f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-42d0ac3a-3194-4cad-bb1a-778965516811 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d" status: 200 len: 1545 microversion: 2.1 time: 0.231249 Apr 24 00:12:36 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:36 2023] GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d => generated 1545 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=14 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:42 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04625ea29ba641fc8342441f61274d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e163039cafd4b2880a41ded2e2f7d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:42 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-13f63d3c-2843-45b0-9127-fd28bd53915d tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 200 len: 1549 microversion: 2.1 time: 0.433689 Apr 24 00:12:42 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 40/117] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:42 2023] GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 1549 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=5 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=3 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:55 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:12:55 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-83acb784-a137-40b7-84bf-4c5f8a7a149b tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7" status: 204 len: 0 microversion: 2.1 time: 0.171446 Apr 24 00:12:55 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 40/118] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:12:55 2023] DELETE /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:56 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-dd1b9261-37c9-4a30-8167-d60d6af38a56 req-5e6d8c47-3af1-4e18-80b1-0bdf2917bdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce8722e-982a-458a-9efb-59d08a5717c7", "name": "network-vif-unplugged", "status": "completed", "tag": "caba6f96-07db-411c-a38b-86be3bb1c71a"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:56 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:56 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:12:56 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31621d02dc5143689c0d8c1280479fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebbe37ffda44c76a78244b3928f809b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:12:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-dd1b9261-37c9-4a30-8167-d60d6af38a56 req-5e6d8c47-3af1-4e18-80b1-0bdf2917bdf7 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-dd1b9261-37c9-4a30-8167-d60d6af38a56 req-5e6d8c47-3af1-4e18-80b1-0bdf2917bdf7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-dd1b9261-37c9-4a30-8167-d60d6af38a56 req-5e6d8c47-3af1-4e18-80b1-0bdf2917bdf7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-767d47d1-4e5b-4349-a6c8-510308dfad5d tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7" status: 200 len: 1490 microversion: 2.1 time: 0.244131 Apr 24 00:12:56 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 39/119] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:12:55 2023] GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7 => generated 1490 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:12:56 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-dd1b9261-37c9-4a30-8167-d60d6af38a56 req-5e6d8c47-3af1-4e18-80b1-0bdf2917bdf7 service nova] Creating event network-vif-unplugged:caba6f96-07db-411c-a38b-86be3bb1c71a for instance dce8722e-982a-458a-9efb-59d08a5717c7 on user Apr 24 00:12:56 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-dd1b9261-37c9-4a30-8167-d60d6af38a56 req-5e6d8c47-3af1-4e18-80b1-0bdf2917bdf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053310 Apr 24 00:12:56 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-0109fdef-6dee-41b9-ba96-cf56d5e42bc3 req-dca40480-445d-462b-9de9-8bb64ce97d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce8722e-982a-458a-9efb-59d08a5717c7", "name": "network-vif-deleted", "tag": "caba6f96-07db-411c-a38b-86be3bb1c71a"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0109fdef-6dee-41b9-ba96-cf56d5e42bc3 req-dca40480-445d-462b-9de9-8bb64ce97d9f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0109fdef-6dee-41b9-ba96-cf56d5e42bc3 req-dca40480-445d-462b-9de9-8bb64ce97d9f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0109fdef-6dee-41b9-ba96-cf56d5e42bc3 req-dca40480-445d-462b-9de9-8bb64ce97d9f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-0109fdef-6dee-41b9-ba96-cf56d5e42bc3 req-dca40480-445d-462b-9de9-8bb64ce97d9f service nova] Creating event network-vif-deleted:caba6f96-07db-411c-a38b-86be3bb1c71a for instance dce8722e-982a-458a-9efb-59d08a5717c7 on user Apr 24 00:12:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-0109fdef-6dee-41b9-ba96-cf56d5e42bc3 req-dca40480-445d-462b-9de9-8bb64ce97d9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031903 Apr 24 00:12:57 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:12:58 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-2f05ee8d-0b6a-49b5-9384-967319cb222b req-c0908fdf-2d26-4c83-960b-4cc1c6a704da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce8722e-982a-458a-9efb-59d08a5717c7", "name": "network-vif-plugged", "status": "completed", "tag": "caba6f96-07db-411c-a38b-86be3bb1c71a"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:12:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-2f05ee8d-0b6a-49b5-9384-967319cb222b req-c0908fdf-2d26-4c83-960b-4cc1c6a704da service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:12:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-2f05ee8d-0b6a-49b5-9384-967319cb222b req-c0908fdf-2d26-4c83-960b-4cc1c6a704da service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:12:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-2f05ee8d-0b6a-49b5-9384-967319cb222b req-c0908fdf-2d26-4c83-960b-4cc1c6a704da service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:12:58 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-2f05ee8d-0b6a-49b5-9384-967319cb222b req-c0908fdf-2d26-4c83-960b-4cc1c6a704da service nova] Creating event network-vif-plugged:caba6f96-07db-411c-a38b-86be3bb1c71a for instance dce8722e-982a-458a-9efb-59d08a5717c7 on user Apr 24 00:12:58 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-2f05ee8d-0b6a-49b5-9384-967319cb222b req-c0908fdf-2d26-4c83-960b-4cc1c6a704da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031417 Apr 24 00:12:58 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:01 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:01 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-50195e29-82f1-4103-9b72-a0ef79b7a851 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 200 len: 1504 microversion: 2.1 time: 0.414500 Apr 24 00:13:01 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:01 2023] GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-5c7984ca-fb3a-4d20-8f5d-d7b98f09800b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.166135 Apr 24 00:13:08 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 42/124] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:13:08 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5/os-interface => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=8 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:09 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-3101f0a4-10c5-45de-b955-b9f30a80b08b req-7a77b534-9970-4470-84d8-94603a2bda89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:09 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-3101f0a4-10c5-45de-b955-b9f30a80b08b req-7a77b534-9970-4470-84d8-94603a2bda89 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:09 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-3101f0a4-10c5-45de-b955-b9f30a80b08b req-7a77b534-9970-4470-84d8-94603a2bda89 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:09 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-3101f0a4-10c5-45de-b955-b9f30a80b08b req-7a77b534-9970-4470-84d8-94603a2bda89 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:09 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-3101f0a4-10c5-45de-b955-b9f30a80b08b req-7a77b534-9970-4470-84d8-94603a2bda89 service nova] Creating event network-changed:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:13:09 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-3101f0a4-10c5-45de-b955-b9f30a80b08b req-7a77b534-9970-4470-84d8-94603a2bda89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040716 Apr 24 00:13:09 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:09 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-1980cf8c-cde9-48f1-ae3c-ec2a717ba4ef tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5/ips" status: 200 len: 104 microversion: 2.1 time: 0.072764 Apr 24 00:13:09 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 43/126] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:13:09 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5/ips => generated 104 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:13:11 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-b05f9b0c-b584-43c3-a485-fd3a450d227d tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 204 len: 0 microversion: 2.1 time: 0.383636 Apr 24 00:13:11 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:13:11 2023] DELETE /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-bd556249-25e8-4d5e-b3ef-8469b711785e req-79ea5f29-e4a7-4128-be24-c508644a526a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bd556249-25e8-4d5e-b3ef-8469b711785e req-79ea5f29-e4a7-4128-be24-c508644a526a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bd556249-25e8-4d5e-b3ef-8469b711785e req-79ea5f29-e4a7-4128-be24-c508644a526a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bd556249-25e8-4d5e-b3ef-8469b711785e req-79ea5f29-e4a7-4128-be24-c508644a526a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-bd556249-25e8-4d5e-b3ef-8469b711785e req-79ea5f29-e4a7-4128-be24-c508644a526a service nova] Creating event network-vif-unplugged:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:13:11 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-bd556249-25e8-4d5e-b3ef-8469b711785e req-79ea5f29-e4a7-4128-be24-c508644a526a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033657 Apr 24 00:13:11 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:11 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-48430cbe-4d1b-4507-a203-17fd2952518d tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d" status: 204 len: 0 microversion: 2.1 time: 0.158825 Apr 24 00:13:11 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 44/129] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:13:11 2023] DELETE /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:11 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:12 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-646ac53d-8e0c-43c2-92a0-1fe0bf0a7595 req-c89b9a24-95cc-416a-a068-a487d78771e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-unplugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:12 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-646ac53d-8e0c-43c2-92a0-1fe0bf0a7595 req-c89b9a24-95cc-416a-a068-a487d78771e6 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:12 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-646ac53d-8e0c-43c2-92a0-1fe0bf0a7595 req-c89b9a24-95cc-416a-a068-a487d78771e6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:12 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-646ac53d-8e0c-43c2-92a0-1fe0bf0a7595 req-c89b9a24-95cc-416a-a068-a487d78771e6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:12 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-646ac53d-8e0c-43c2-92a0-1fe0bf0a7595 req-c89b9a24-95cc-416a-a068-a487d78771e6 service nova] Creating event network-vif-unplugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:13:12 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-646ac53d-8e0c-43c2-92a0-1fe0bf0a7595 req-c89b9a24-95cc-416a-a068-a487d78771e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032732 Apr 24 00:13:12 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:12 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf55386d2654a1e86af6882a2aed860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218aba2df07b4afaa999399d0981e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:12 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-7d82762d-0b17-47be-8b03-e015e09f4b69 tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d" status: 200 len: 1494 microversion: 2.1 time: 0.328724 Apr 24 00:13:12 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 45/131] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:11 2023] GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d => generated 1494 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:13:12 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471d341199f0431a95ae54651c4f0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d063c2bdc884fb8b826b9fb6fd97405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:12 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-8c650bae-fb65-4abb-a7e9-822256a3692a tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 200 len: 1662 microversion: 2.1 time: 0.708609 Apr 24 00:13:12 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 42/132] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:11 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 1662 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:13:12 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1213468308", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "2b9edd97-2af0-4b09-993c-95cc2b427fd8"}]}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:12 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] validate_networks() for [('2b9edd97-2af0-4b09-993c-95cc2b427fd8', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:13:13 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-3991a5ec-9bb3-4ba8-8466-58fcc5f19574 req-1ab1a88e-d85b-4fdf-a8cb-eafcc59e7439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "name": "network-vif-plugged", "status": "completed", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-3991a5ec-9bb3-4ba8-8466-58fcc5f19574 req-1ab1a88e-d85b-4fdf-a8cb-eafcc59e7439 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-3991a5ec-9bb3-4ba8-8466-58fcc5f19574 req-1ab1a88e-d85b-4fdf-a8cb-eafcc59e7439 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-3991a5ec-9bb3-4ba8-8466-58fcc5f19574 req-1ab1a88e-d85b-4fdf-a8cb-eafcc59e7439 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:13 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-3991a5ec-9bb3-4ba8-8466-58fcc5f19574 req-1ab1a88e-d85b-4fdf-a8cb-eafcc59e7439 service nova] Creating event network-vif-plugged:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:13:13 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-3991a5ec-9bb3-4ba8-8466-58fcc5f19574 req-1ab1a88e-d85b-4fdf-a8cb-eafcc59e7439 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Apr 24 00:13:13 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-plugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}, {"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-plugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}, {"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-plugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Creating event network-vif-plugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:13:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Creating event network-vif-plugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:13:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] Creating event network-vif-plugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:13:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-b055a66d-c1c8-4266-a077-59a386acc47f req-53897808-8bc3-4730-9cbf-ed2737c1cf0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.086353 Apr 24 00:13:14 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 43/134] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Getting quotas for project ce75f63fc0904eceb03e8319bddba4d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Getting quotas for user abae98323deb44dea0622186485cc7af and project ce75f63fc0904eceb03e8319bddba4d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:13:14 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-bac3d3f4-0452-4c2e-bbcc-20783774ebdc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.730685 Apr 24 00:13:14 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 46/135] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:13:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:13:14 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-07752a2a-3a63-47e3-a751-d8519d1e7654 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:14 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-07752a2a-3a63-47e3-a751-d8519d1e7654 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-07752a2a-3a63-47e3-a751-d8519d1e7654 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:14 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-07752a2a-3a63-47e3-a751-d8519d1e7654 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 200 len: 1211 microversion: 2.1 time: 0.093693 Apr 24 00:13:14 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:14 2023] GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-59c8e156-4055-40f6-aa9d-147571cff109 req-6ab44ad4-036b-4560-b5d8-380ac8d1a7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212a2ad6-77ab-4615-b6ca-f426a3e76ab5", "name": "network-vif-deleted", "tag": "81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-59c8e156-4055-40f6-aa9d-147571cff109 req-6ab44ad4-036b-4560-b5d8-380ac8d1a7e6 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-59c8e156-4055-40f6-aa9d-147571cff109 req-6ab44ad4-036b-4560-b5d8-380ac8d1a7e6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-59c8e156-4055-40f6-aa9d-147571cff109 req-6ab44ad4-036b-4560-b5d8-380ac8d1a7e6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-59c8e156-4055-40f6-aa9d-147571cff109 req-6ab44ad4-036b-4560-b5d8-380ac8d1a7e6 service nova] Creating event network-vif-deleted:81bcd0fd-3b1f-4890-b1fb-3086a1ac8a54 for instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 on user Apr 24 00:13:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-59c8e156-4055-40f6-aa9d-147571cff109 req-6ab44ad4-036b-4560-b5d8-380ac8d1a7e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081927 Apr 24 00:13:14 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:14 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:14 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-4e5da989-4d5e-4416-aacb-0c1707b255a4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.181462 Apr 24 00:13:14 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 47/138] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 24 00:13:14 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:16 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:16 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-71e9ce0f-94d4-423b-a432-e826f8164740 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887/ips" status: 200 len: 110 microversion: 2.20 time: 0.052524 Apr 24 00:13:16 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 48/139] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Apr 24 00:13:16 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887/ips => generated 110 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:13:16 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-plugged", "status": "completed", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}, {"server_uuid": "ffbf17ce-e3cb-4099-bea3-6887fef4476d", "name": "network-vif-deleted", "tag": "be0c060b-e1fe-496e-8827-a2699e8a4017"}, {"name": "network-changed", "server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:16 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:16 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:16 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Creating event network-vif-plugged:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:13:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Creating event network-vif-deleted:be0c060b-e1fe-496e-8827-a2699e8a4017 for instance ffbf17ce-e3cb-4099-bea3-6887fef4476d on user Apr 24 00:13:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] Creating event network-changed:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:13:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-cd9ff962-30c4-4e80-be31-a2f99d72dc01 req-85687f0d-f09b-4ad2-acc5-404410f5e1f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.042299 Apr 24 00:13:16 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:16 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-58118f99-ec29-4964-a953-34b866c5f9fb req-4af872d0-a0ab-49b7-9481-4e536594d4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1821ecf2-8c71-48ad-96da-f63b83439c6d", "tag": "86355003-a71c-4c4f-9536-beab8f09ded2"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-58118f99-ec29-4964-a953-34b866c5f9fb req-4af872d0-a0ab-49b7-9481-4e536594d4e2 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-58118f99-ec29-4964-a953-34b866c5f9fb req-4af872d0-a0ab-49b7-9481-4e536594d4e2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-58118f99-ec29-4964-a953-34b866c5f9fb req-4af872d0-a0ab-49b7-9481-4e536594d4e2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-339196851"}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-58118f99-ec29-4964-a953-34b866c5f9fb req-4af872d0-a0ab-49b7-9481-4e536594d4e2 service nova] Creating event network-changed:86355003-a71c-4c4f-9536-beab8f09ded2 for instance 1821ecf2-8c71-48ad-96da-f63b83439c6d on user Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-58118f99-ec29-4964-a953-34b866c5f9fb req-4af872d0-a0ab-49b7-9481-4e536594d4e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030943 Apr 24 00:13:17 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 49/141] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-db748f70-29ef-4bf2-9d83-549f8e74e627 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 204 len: 0 microversion: 2.20 time: 0.130434 Apr 24 00:13:17 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 48/142] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:13:17 2023] DELETE /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:17 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:17 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e58c06e3-7239-4d42-8574-6880549c97d6 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 200 len: 1711 microversion: 2.20 time: 0.288968 Apr 24 00:13:17 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 50/143] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:13:17 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 1711 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:13:18 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "name": "network-vif-unplugged", "status": "completed", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}, {"server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "name": "network-vif-plugged", "status": "completed", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:18 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] Creating event network-vif-unplugged:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:13:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] Creating event network-vif-plugged:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:13:18 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-3724c3cf-1abb-43b8-99d2-7f7b63f0bd3b req-7597c7a8-af68-42f9-ae1d-871a58539b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038238 Apr 24 00:13:18 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 49/144] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:18 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:18 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-66214f98-5ae2-4a17-870b-ecf3c18cfc93 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b/action" status: 202 len: 52 microversion: 2.87 time: 1.084657 Apr 24 00:13:18 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 46/145] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 24 00:13:17 2023] POST /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b/action => generated 52 bytes in 1087 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 24 00:13:19 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-06381364-4611-480d-8a8f-7f3dc95d4c5e req-1fff58b6-2aeb-45e2-b1c8-810d260c526e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e762c863-43e1-4f26-ab6b-c8ea40f08887", "name": "network-vif-deleted", "tag": "d90cab57-5c57-410a-a61e-ab316454a676"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-06381364-4611-480d-8a8f-7f3dc95d4c5e req-1fff58b6-2aeb-45e2-b1c8-810d260c526e service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-06381364-4611-480d-8a8f-7f3dc95d4c5e req-1fff58b6-2aeb-45e2-b1c8-810d260c526e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-06381364-4611-480d-8a8f-7f3dc95d4c5e req-1fff58b6-2aeb-45e2-b1c8-810d260c526e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-06381364-4611-480d-8a8f-7f3dc95d4c5e req-1fff58b6-2aeb-45e2-b1c8-810d260c526e service nova] Creating event network-vif-deleted:d90cab57-5c57-410a-a61e-ab316454a676 for instance e762c863-43e1-4f26-ab6b-c8ea40f08887 on user Apr 24 00:13:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-06381364-4611-480d-8a8f-7f3dc95d4c5e req-1fff58b6-2aeb-45e2-b1c8-810d260c526e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046554 Apr 24 00:13:19 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 51/146] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:19 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-97884ac8-3841-4506-9d5b-0ce507d769b6 req-314f97d1-a3d8-4ee0-87b2-3310497ac486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1821ecf2-8c71-48ad-96da-f63b83439c6d", "name": "network-vif-plugged", "status": "completed", "tag": "86355003-a71c-4c4f-9536-beab8f09ded2"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:19 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-97884ac8-3841-4506-9d5b-0ce507d769b6 req-314f97d1-a3d8-4ee0-87b2-3310497ac486 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:19 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-97884ac8-3841-4506-9d5b-0ce507d769b6 req-314f97d1-a3d8-4ee0-87b2-3310497ac486 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:19 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-97884ac8-3841-4506-9d5b-0ce507d769b6 req-314f97d1-a3d8-4ee0-87b2-3310497ac486 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:19 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-97884ac8-3841-4506-9d5b-0ce507d769b6 req-314f97d1-a3d8-4ee0-87b2-3310497ac486 service nova] Creating event network-vif-plugged:86355003-a71c-4c4f-9536-beab8f09ded2 for instance 1821ecf2-8c71-48ad-96da-f63b83439c6d on user Apr 24 00:13:19 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-97884ac8-3841-4506-9d5b-0ce507d769b6 req-314f97d1-a3d8-4ee0-87b2-3310497ac486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034776 Apr 24 00:13:19 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:22 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-7e84607a-21f4-4c3a-b8f4-4ad1eb075174 req-041f8a99-9b17-4d1f-9671-ff374c3f3329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1821ecf2-8c71-48ad-96da-f63b83439c6d", "name": "network-vif-plugged", "status": "completed", "tag": "86355003-a71c-4c4f-9536-beab8f09ded2"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-7e84607a-21f4-4c3a-b8f4-4ad1eb075174 req-041f8a99-9b17-4d1f-9671-ff374c3f3329 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-7e84607a-21f4-4c3a-b8f4-4ad1eb075174 req-041f8a99-9b17-4d1f-9671-ff374c3f3329 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-7e84607a-21f4-4c3a-b8f4-4ad1eb075174 req-041f8a99-9b17-4d1f-9671-ff374c3f3329 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:22 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-7e84607a-21f4-4c3a-b8f4-4ad1eb075174 req-041f8a99-9b17-4d1f-9671-ff374c3f3329 service nova] Creating event network-vif-plugged:86355003-a71c-4c4f-9536-beab8f09ded2 for instance 1821ecf2-8c71-48ad-96da-f63b83439c6d on user Apr 24 00:13:22 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-7e84607a-21f4-4c3a-b8f4-4ad1eb075174 req-041f8a99-9b17-4d1f-9671-ff374c3f3329 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027616 Apr 24 00:13:22 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 47/148] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:24 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:24 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:24 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:24 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-70b8d142-7653-4368-84c5-e29d8d19cc3a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b" status: 200 len: 1690 microversion: 2.87 time: 0.278023 Apr 24 00:13:24 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 52/149] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:13:23 2023] GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b => generated 1690 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:37 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-9462336b-a7fb-408f-889a-8432e9d72a48 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.214049 Apr 24 00:13:37 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 51/150] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:13:37 2023] GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d/os-interface => generated 283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=14 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:38 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-369bb842-571b-4775-aecd-a782e2190f44 req-6a5be319-cfb3-42bd-928d-bf9cf8ce2f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-369bb842-571b-4775-aecd-a782e2190f44 req-6a5be319-cfb3-42bd-928d-bf9cf8ce2f83 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-369bb842-571b-4775-aecd-a782e2190f44 req-6a5be319-cfb3-42bd-928d-bf9cf8ce2f83 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-369bb842-571b-4775-aecd-a782e2190f44 req-6a5be319-cfb3-42bd-928d-bf9cf8ce2f83 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:38 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-369bb842-571b-4775-aecd-a782e2190f44 req-6a5be319-cfb3-42bd-928d-bf9cf8ce2f83 service nova] Creating event network-changed:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:13:38 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-369bb842-571b-4775-aecd-a782e2190f44 req-6a5be319-cfb3-42bd-928d-bf9cf8ce2f83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Apr 24 00:13:38 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 48/151] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:39 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-228310302", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "fc4a840b-9c4f-4c52-8a4e-411d66ac14e1"}]}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:39 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:39 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:39 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:13:39 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] validate_networks() for [('fc4a840b-9c4f-4c52-8a4e-411d66ac14e1', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Getting quotas for project df0187dbb10d42da941645107df203f6. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Getting quotas for user 640ec20e46a2422a8aabcc152e522e02 and project df0187dbb10d42da941645107df203f6. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:13:40 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:13:40 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-c2424c7f-7f0e-4e99-a47b-c0a178ef366f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.458061 Apr 24 00:13:40 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 53/152] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:13:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:13:40 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-765d416d-e550-4bc8-b3f6-6b974c6d1a52 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:40 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-765d416d-e550-4bc8-b3f6-6b974c6d1a52 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:40 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-765d416d-e550-4bc8-b3f6-6b974c6d1a52 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640ec20e46a2422a8aabcc152e522e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0187dbb10d42da941645107df203f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:40 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-765d416d-e550-4bc8-b3f6-6b974c6d1a52 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426" status: 200 len: 1211 microversion: 2.1 time: 0.064930 Apr 24 00:13:40 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:40 2023] GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426 => generated 1211 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:42 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:42 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-5f502d6c-b64c-47b2-9d6e-d0769e2ade80 req-de538814-8a89-4423-9c19-a4d8ba2bff1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a3766c-0a08-4eb5-a833-e39eb73d3426", "tag": "5b300cf4-3c09-440b-8992-08ebf1a3d958"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-5f502d6c-b64c-47b2-9d6e-d0769e2ade80 req-de538814-8a89-4423-9c19-a4d8ba2bff1d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-5f502d6c-b64c-47b2-9d6e-d0769e2ade80 req-de538814-8a89-4423-9c19-a4d8ba2bff1d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-5f502d6c-b64c-47b2-9d6e-d0769e2ade80 req-de538814-8a89-4423-9c19-a4d8ba2bff1d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:42 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-5f502d6c-b64c-47b2-9d6e-d0769e2ade80 req-de538814-8a89-4423-9c19-a4d8ba2bff1d service nova] Creating event network-changed:5b300cf4-3c09-440b-8992-08ebf1a3d958 for instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 on user Apr 24 00:13:42 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-5f502d6c-b64c-47b2-9d6e-d0769e2ade80 req-de538814-8a89-4423-9c19-a4d8ba2bff1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028188 Apr 24 00:13:42 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 54/154] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:42 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-a23f8c0e-c428-425e-81a3-0a4f1d0dfc51 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.169410 Apr 24 00:13:42 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 49/155] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:13:42 2023] GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:43 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-81be1604-36c1-4ae8-8772-d72c8888cf25 req-c96c8c88-a14b-4950-96c7-64a5cca4d3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-81be1604-36c1-4ae8-8772-d72c8888cf25 req-c96c8c88-a14b-4950-96c7-64a5cca4d3fe service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-81be1604-36c1-4ae8-8772-d72c8888cf25 req-c96c8c88-a14b-4950-96c7-64a5cca4d3fe service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-81be1604-36c1-4ae8-8772-d72c8888cf25 req-c96c8c88-a14b-4950-96c7-64a5cca4d3fe service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:43 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-81be1604-36c1-4ae8-8772-d72c8888cf25 req-c96c8c88-a14b-4950-96c7-64a5cca4d3fe service nova] Creating event network-changed:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:13:43 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-81be1604-36c1-4ae8-8772-d72c8888cf25 req-c96c8c88-a14b-4950-96c7-64a5cca4d3fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035905 Apr 24 00:13:43 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:13:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-368298a1-d90b-4019-8e42-332edd486850 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 204 len: 0 microversion: 2.1 time: 0.111979 Apr 24 00:13:45 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 55/157] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:13:45 2023] DELETE /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:45 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04625ea29ba641fc8342441f61274d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e163039cafd4b2880a41ded2e2f7d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:13:45 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-6de75419-2496-4ce5-83c5-0b717d62e50c tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 200 len: 1674 microversion: 2.1 time: 0.175203 Apr 24 00:13:45 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 50/158] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:45 2023] GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:13:45 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-77d57db2-0f34-46ec-ba8c-bdfc99babb68 req-cea6014f-8ded-4027-a8c8-b7d148dd19f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "name": "network-vif-unplugged", "status": "completed", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-77d57db2-0f34-46ec-ba8c-bdfc99babb68 req-cea6014f-8ded-4027-a8c8-b7d148dd19f3 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-77d57db2-0f34-46ec-ba8c-bdfc99babb68 req-cea6014f-8ded-4027-a8c8-b7d148dd19f3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-77d57db2-0f34-46ec-ba8c-bdfc99babb68 req-cea6014f-8ded-4027-a8c8-b7d148dd19f3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:45 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-77d57db2-0f34-46ec-ba8c-bdfc99babb68 req-cea6014f-8ded-4027-a8c8-b7d148dd19f3 service nova] Creating event network-vif-unplugged:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:13:45 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-77d57db2-0f34-46ec-ba8c-bdfc99babb68 req-cea6014f-8ded-4027-a8c8-b7d148dd19f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031693 Apr 24 00:13:45 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 54/159] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a3766c-0a08-4eb5-a833-e39eb73d3426", "name": "network-vif-plugged", "status": "completed", "tag": "5b300cf4-3c09-440b-8992-08ebf1a3d958"}, {"server_uuid": "f2a3766c-0a08-4eb5-a833-e39eb73d3426", "name": "network-vif-plugged", "status": "completed", "tag": "5b300cf4-3c09-440b-8992-08ebf1a3d958"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] Creating event network-vif-plugged:5b300cf4-3c09-440b-8992-08ebf1a3d958 for instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 on user Apr 24 00:13:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] Creating event network-vif-plugged:5b300cf4-3c09-440b-8992-08ebf1a3d958 for instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 on user Apr 24 00:13:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-328d8f86-b2c5-40e1-ba14-9f3fdf88a4e9 req-561e05cd-5c42-4cc4-a5b5-4ad699e348e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037434 Apr 24 00:13:45 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 56/160] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] [instance: dce8722e-982a-458a-9efb-59d08a5717c7] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] HTTP exception thrown: Instance dce8722e-982a-458a-9efb-59d08a5717c7 could not be found. Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Request method failure captured: Apr 24 00:13:46 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7 HTTP/1.1 Apr 24 00:13:46 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:13:46 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:13:46 user devstack@n-api.service[61491]: Connection: close Apr 24 00:13:46 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:13:46 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:13:46 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:13:46 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:13:46 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRckRTVuMwhXAeNegs7bcOJ_R-xmqjEtJYyiweyQRne-Am5yyrWKV6x9uZvLXaYOXhHBLjU1TvD2YlNch0yqUtE05BV-w_D8Qu4bvQ4bBFfHoxbQ0PLTnRtY-uz7mTaY_SXJOBhIvfuePdtJT7F8qz-inoCMTii1Dm_AFYpl3wye_3Ks Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Project-Id: 4ebbe37ffda44c76a78244b3928f809b Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Project-Name: tempest-VolumesActionsTest-1689103952 Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ebbe37ffda44c76a78244b3928f809b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ebbe37ffda44c76a78244b3928f809b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4ebbe37ffda44c76a78244b3928f809b"}]}] Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Tenant: tempest-VolumesActionsTest-1689103952 Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Tenant-Id: 4ebbe37ffda44c76a78244b3928f809b Apr 24 00:13:46 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-VolumesActionsTest-1689103952 Apr 24 00:13:46 user devstack@n-api.service[61491]: X-User: tempest-VolumesActionsTest-1689103952-project-member Apr 24 00:13:46 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:13:46 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:13:46 user devstack@n-api.service[61491]: X-User-Id: 31621d02dc5143689c0d8c1280479fdc Apr 24 00:13:46 user devstack@n-api.service[61491]: X-User-Name: tempest-VolumesActionsTest-1689103952-project-member Apr 24 00:13:46 user devstack@n-api.service[61491]: method: > Apr 24 00:13:46 user devstack@n-api.service[61491]: exception: Instance dce8722e-982a-458a-9efb-59d08a5717c7 could not be found. Apr 24 00:13:46 user devstack@n-api.service[61491]: action_args: {'id': 'dce8722e-982a-458a-9efb-59d08a5717c7'} Apr 24 00:13:46 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce8722e-982a-458a-9efb-59d08a5717c7 could not be found. Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce8722e-982a-458a-9efb-59d08a5717c7 could not be found. Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce8722e-982a-458a-9efb-59d08a5717c7 could not be found. Apr 24 00:13:46 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:13:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] Returning 404 to user: Instance dce8722e-982a-458a-9efb-59d08a5717c7 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:13:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-548e2111-18ac-4226-975d-a3e52d05e9c5 tempest-VolumesActionsTest-1689103952 tempest-VolumesActionsTest-1689103952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7" status: 404 len: 111 microversion: 2.1 time: 0.035465 Apr 24 00:13:46 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 51/161] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:13:46 2023] GET /compute/v2.1/servers/dce8722e-982a-458a-9efb-59d08a5717c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:13:47 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "name": "network-vif-plugged", "status": "completed", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}, {"server_uuid": "5e7bfc8d-7d4a-42f7-9657-cc65e1364b87", "name": "network-vif-deleted", "tag": "5a56c96a-0083-47e5-819c-1d802bbcd6ea"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:13:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:13:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:13:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:13:47 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] Creating event network-vif-plugged:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:13:47 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] Creating event network-vif-deleted:5a56c96a-0083-47e5-819c-1d802bbcd6ea for instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 on user Apr 24 00:13:47 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-93f4177c-8f69-47e2-b6a4-8446eb1c5b55 req-2977d797-00ca-4e7b-a87f-feee50d2685b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034692 Apr 24 00:13:47 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 55/162] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:01 user devstack@n-api.service[61492]: DEBUG nova.objects.instance [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lazy-loading 'flavor' on Instance uuid f1a14b79-7792-4962-bbe1-ec11e10e6948 {{(pid=61492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 24 00:14:01 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-2966e44c-c257-42ed-97d6-703c862b6f57 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948/action" status: 200 len: 32 microversion: 2.1 time: 0.140834 Apr 24 00:14:01 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 57/163] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 24 00:14:01 2023] POST /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=8 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=14 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:02 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:02 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-150628fb-bacd-470a-ab92-5b0a7d9b2a0b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 200 len: 1510 microversion: 2.1 time: 0.334849 Apr 24 00:14:02 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 52/164] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:01 2023] GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=12 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=10 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] [instance: ffbf17ce-e3cb-4099-bea3-6887fef4476d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:02 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] HTTP exception thrown: Instance ffbf17ce-e3cb-4099-bea3-6887fef4476d could not be found. Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Request method failure captured: Apr 24 00:14:02 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d HTTP/1.1 Apr 24 00:14:02 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:14:02 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:14:02 user devstack@n-api.service[61493]: Connection: close Apr 24 00:14:02 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:14:02 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:14:02 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:14:02 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:14:02 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcklKqjRoEvyyPy6RIxni4gNb94pJOiKDJ66vavIOYr2oKh8lw1GCIxeO2tOSirYGwBibn3P2WeSUt7WWNAzMpmc5kdIE91ZFrOq2iDJw_GgcBU1ZWxqZgn4QK6mBMOmZhJutSqj9ICvNTWZx-3HbsWaPq0qtBze8w3PGgANTk-B0cU Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Project-Id: 218aba2df07b4afaa999399d0981e6bf Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Project-Name: tempest-DeleteServersTestJSON-1102950130 Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/218aba2df07b4afaa999399d0981e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/218aba2df07b4afaa999399d0981e6bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/218aba2df07b4afaa999399d0981e6bf"}]}] Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Tenant: tempest-DeleteServersTestJSON-1102950130 Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Tenant-Id: 218aba2df07b4afaa999399d0981e6bf Apr 24 00:14:02 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102950130 Apr 24 00:14:02 user devstack@n-api.service[61493]: X-User: tempest-DeleteServersTestJSON-1102950130-project-member Apr 24 00:14:02 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:14:02 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:14:02 user devstack@n-api.service[61493]: X-User-Id: 9cf55386d2654a1e86af6882a2aed860 Apr 24 00:14:02 user devstack@n-api.service[61493]: X-User-Name: tempest-DeleteServersTestJSON-1102950130-project-member Apr 24 00:14:02 user devstack@n-api.service[61493]: method: > Apr 24 00:14:02 user devstack@n-api.service[61493]: exception: Instance ffbf17ce-e3cb-4099-bea3-6887fef4476d could not be found. Apr 24 00:14:02 user devstack@n-api.service[61493]: action_args: {'id': 'ffbf17ce-e3cb-4099-bea3-6887fef4476d'} Apr 24 00:14:02 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffbf17ce-e3cb-4099-bea3-6887fef4476d could not be found. Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffbf17ce-e3cb-4099-bea3-6887fef4476d could not be found. Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffbf17ce-e3cb-4099-bea3-6887fef4476d could not be found. Apr 24 00:14:02 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] Returning 404 to user: Instance ffbf17ce-e3cb-4099-bea3-6887fef4476d could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:14:02 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-c763647e-8d1a-4fba-b46a-54ad5f70550a tempest-DeleteServersTestJSON-1102950130 tempest-DeleteServersTestJSON-1102950130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d" status: 404 len: 111 microversion: 2.1 time: 0.042394 Apr 24 00:14:02 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:02 2023] GET /compute/v2.1/servers/ffbf17ce-e3cb-4099-bea3-6887fef4476d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] HTTP exception thrown: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Request method failure captured: Apr 24 00:14:02 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 HTTP/1.1 Apr 24 00:14:02 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:14:02 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:14:02 user devstack@n-api.service[61492]: Connection: close Apr 24 00:14:02 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:14:02 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:14:02 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:14:02 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:14:02 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRckZu1BgVOzfEZDzJ2-HCTuZbCBukUCL8fhgRaQH1vFvil_nfiLiz-gd1UT9LTv8cnRLdw2HZoSFJ6hICCJLxpq4Tn4eqp8L1CSstH_lKlmvt2lahP0J94yS8F-vCxf7YQT6sNiQPQWtt_G47t9RL-JyPAdhmproCEMOpki5QWNiKR0 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Project-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d063c2bdc884fb8b826b9fb6fd97405"}]}] Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Tenant-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:14:02 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:14:02 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:14:02 user devstack@n-api.service[61492]: X-User-Id: 471d341199f0431a95ae54651c4f0780 Apr 24 00:14:02 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:14:02 user devstack@n-api.service[61492]: method: > Apr 24 00:14:02 user devstack@n-api.service[61492]: exception: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:14:02 user devstack@n-api.service[61492]: action_args: {'id': '212a2ad6-77ab-4615-b6ca-f426a3e76ab5'} Apr 24 00:14:02 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:14:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Returning 404 to user: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:14:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-b2cdde38-7b0e-42a0-8663-72690cdf6ea7 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 404 len: 111 microversion: 2.1 time: 0.035754 Apr 24 00:14:02 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 58/166] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:02 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:14:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-9d833088-375c-4804-855b-89e6e14cb29c tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '.version_select at 0x7fc8c384a440>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:02 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-9d833088-375c-4804-855b-89e6e14cb29c tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814203803" status: 202 len: 0 microversion: 2.1 time: 0.034433 Apr 24 00:14:02 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 53/167] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 24 00:14:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814203803 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-5bea7efb-096a-4e89-84eb-47007586674f req-78742c40-0390-41e9-aeea-fdee6049b7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-unplugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-5bea7efb-096a-4e89-84eb-47007586674f req-78742c40-0390-41e9-aeea-fdee6049b7e7 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-5bea7efb-096a-4e89-84eb-47007586674f req-78742c40-0390-41e9-aeea-fdee6049b7e7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-5bea7efb-096a-4e89-84eb-47007586674f req-78742c40-0390-41e9-aeea-fdee6049b7e7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:02 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-5bea7efb-096a-4e89-84eb-47007586674f req-78742c40-0390-41e9-aeea-fdee6049b7e7 service nova] Creating event network-vif-unplugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:14:02 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-5bea7efb-096a-4e89-84eb-47007586674f req-78742c40-0390-41e9-aeea-fdee6049b7e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030035 Apr 24 00:14:02 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:03 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1cf2a35b-3394-4cbc-86fc-9d73824cf71c tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3708160>, body: {"keypair": {"name": "tempest-keypair-670582452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcfTjP5WJcryNzsqlkun8gR9wahBjjV98bivT/lgH0hNMo4q0VTdNxQslRxtaeP2me2yW9f66D9TwOftMRDgzVFqTefGAIW0hAhjgdNDN4d4jy/uJaM5+9CQHsIpBa8tQ=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:03 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-1cf2a35b-3394-4cbc-86fc-9d73824cf71c tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:03 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-1cf2a35b-3394-4cbc-86fc-9d73824cf71c tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for user 471d341199f0431a95ae54651c4f0780 and project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:03 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-1cf2a35b-3394-4cbc-86fc-9d73824cf71c tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067924 Apr 24 00:14:03 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 59/169] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:14:03 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:04 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-8752fc2f-9518-4ac9-9096-870cd8694cd5 req-31d59a52-956c-4554-90eb-584e34126bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:04 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-8752fc2f-9518-4ac9-9096-870cd8694cd5 req-31d59a52-956c-4554-90eb-584e34126bdd service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:04 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-8752fc2f-9518-4ac9-9096-870cd8694cd5 req-31d59a52-956c-4554-90eb-584e34126bdd service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:04 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-8752fc2f-9518-4ac9-9096-870cd8694cd5 req-31d59a52-956c-4554-90eb-584e34126bdd service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:04 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-8752fc2f-9518-4ac9-9096-870cd8694cd5 req-31d59a52-956c-4554-90eb-584e34126bdd service nova] Creating event network-vif-plugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:14:04 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1191061004", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c29459b8-bcaa-41ae-94fa-d61344bae22f"}], "security_groups": [{"name": "tempest-securitygroup--37849048"}], "key_name": "tempest-keypair-670582452", "user_data": "}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:04 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-8752fc2f-9518-4ac9-9096-870cd8694cd5 req-31d59a52-956c-4554-90eb-584e34126bdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038573 Apr 24 00:14:04 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] validate_networks() for [('c29459b8-bcaa-41ae-94fa-d61344bae22f', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:14:05 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:05 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-f51509d4-b14b-4066-bfb7-7eb6d1bbde91 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 200 len: 1494 microversion: 2.1 time: 0.438103 Apr 24 00:14:05 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 54/171] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:04 2023] GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 1494 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Getting quotas for user 471d341199f0431a95ae54651c4f0780 and project 1d063c2bdc884fb8b826b9fb6fd97405. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:14:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:14:05 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-6fd52e5f-5407-478b-8735-204e7d33e9a0 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.765872 Apr 24 00:14:05 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 60/172] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:14:04 2023] POST /compute/v2.1/servers => generated 398 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:14:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-6281fee3-6bcf-48a0-91b0-55aec2d7fe66 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:05 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-6281fee3-6bcf-48a0-91b0-55aec2d7fe66 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:05 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-6281fee3-6bcf-48a0-91b0-55aec2d7fe66 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471d341199f0431a95ae54651c4f0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d063c2bdc884fb8b826b9fb6fd97405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-6281fee3-6bcf-48a0-91b0-55aec2d7fe66 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 200 len: 1231 microversion: 2.1 time: 0.067804 Apr 24 00:14:05 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 59/173] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:05 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 1231 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:06 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}, {"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:06 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:06 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:06 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:06 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] Creating event network-vif-plugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:14:06 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] Creating event network-vif-plugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:14:06 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-56f3c358-e6a4-4582-a085-22ab346b1126 req-a3ee9703-cc90-45d6-aea2-7559b70be608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031173 Apr 24 00:14:06 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 55/174] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] HTTP exception thrown: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Request method failure captured: Apr 24 00:14:08 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 HTTP/1.1 Apr 24 00:14:08 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:14:08 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:14:08 user devstack@n-api.service[61492]: Connection: close Apr 24 00:14:08 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:14:08 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:14:08 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:14:08 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:14:08 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcklAS5hyOYy4tT_9HvV5K5wTiPJaxw9epmIdyPPJNLz5oj9K4JTKsMqNaxJVwuyPqad2YXU0myPv_bU2opvofTJHh4Lo39aUi3WKca85jp_WHQ4FS-HeMCIl7s6-nVoVaKloSKdkHHoqy8KO__Q4iSXMeYB6rfavinVqtISTsOUmIM Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Openstack-Nova-Api-Version: 2.20 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Project-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e2bf3154181247f8963be8cd31399851"}]}] Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Tenant-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:14:08 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:14:08 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:14:08 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:14:08 user devstack@n-api.service[61492]: X-User-Id: 539997e65f4f4ef7998a4386d19a5e9f Apr 24 00:14:08 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:14:08 user devstack@n-api.service[61492]: method: > Apr 24 00:14:08 user devstack@n-api.service[61492]: exception: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:14:08 user devstack@n-api.service[61492]: action_args: {'id': 'e762c863-43e1-4f26-ab6b-c8ea40f08887'} Apr 24 00:14:08 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:14:08 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Returning 404 to user: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:14:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-b14d55b0-6fec-4c74-b218-bdd0345addce tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 404 len: 111 microversion: 2.20 time: 0.032736 Apr 24 00:14:08 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 61/175] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:14:08 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:14:08 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-9793814f-c273-42fb-83a2-dc0768e1785c tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '.version_select at 0x7fc8c38ad1b0>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:08 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-9793814f-c273-42fb-83a2-dc0768e1785c tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573827894" status: 204 len: 0 microversion: 2.20 time: 0.031052 Apr 24 00:14:08 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 60/176] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Apr 24 00:14:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573827894 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:14:08 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-0a4ca54b-b09e-463b-a448-359691c7cf88 req-c7e41f31-e913-43c1-a1aa-f13d34525e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:08 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-0a4ca54b-b09e-463b-a448-359691c7cf88 req-c7e41f31-e913-43c1-a1aa-f13d34525e6f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:08 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-0a4ca54b-b09e-463b-a448-359691c7cf88 req-c7e41f31-e913-43c1-a1aa-f13d34525e6f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:08 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-0a4ca54b-b09e-463b-a448-359691c7cf88 req-c7e41f31-e913-43c1-a1aa-f13d34525e6f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:08 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-0a4ca54b-b09e-463b-a448-359691c7cf88 req-c7e41f31-e913-43c1-a1aa-f13d34525e6f service nova] Creating event network-changed:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:14:08 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-0a4ca54b-b09e-463b-a448-359691c7cf88 req-c7e41f31-e913-43c1-a1aa-f13d34525e6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032157 Apr 24 00:14:08 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 56/177] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:09 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-51f177e1-8a08-4763-920d-916422f556fe tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Action: 'create', calling method: .version_select at 0x7fc8c37092d0>, body: {"keypair": {"name": "tempest-keypair-1058824653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3GEjjTKC06op3WsPivqO+l4BSt54OlT00thV38HKoIy/ZNPvfWSo0jJrcHAlGb/+rJGJfe0UfKW92qrg1FUtDiP9SzVcY4eMX4ApUmWqGlNNLLT473cBCHXS8s2TWXxg=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:09 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-51f177e1-8a08-4763-920d-916422f556fe tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for project e2bf3154181247f8963be8cd31399851. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:09 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-51f177e1-8a08-4763-920d-916422f556fe tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for user 539997e65f4f4ef7998a4386d19a5e9f and project e2bf3154181247f8963be8cd31399851. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:09 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-51f177e1-8a08-4763-920d-916422f556fe tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043827 Apr 24 00:14:09 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 62/178] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 24 00:14:09 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 24 00:14:10 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-0b2730c9-882d-47ac-8e73-b90e3ca46346 req-64241d1d-b613-4771-8418-ef467a7961ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "name": "network-vif-plugged", "status": "completed", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0b2730c9-882d-47ac-8e73-b90e3ca46346 req-64241d1d-b613-4771-8418-ef467a7961ef service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0b2730c9-882d-47ac-8e73-b90e3ca46346 req-64241d1d-b613-4771-8418-ef467a7961ef service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0b2730c9-882d-47ac-8e73-b90e3ca46346 req-64241d1d-b613-4771-8418-ef467a7961ef service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:10 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-0b2730c9-882d-47ac-8e73-b90e3ca46346 req-64241d1d-b613-4771-8418-ef467a7961ef service nova] Creating event network-vif-plugged:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:14:10 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-0b2730c9-882d-47ac-8e73-b90e3ca46346 req-64241d1d-b613-4771-8418-ef467a7961ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190498 Apr 24 00:14:10 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:11 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-593649378", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e09e353d-220c-429c-9767-a11a59bbf99a"}], "security_groups": [{"name": "tempest-securitygroup--880137050"}], "key_name": "tempest-keypair-1058824653", "user_data": "}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:11 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] validate_networks() for [('e09e353d-220c-429c-9767-a11a59bbf99a', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for project e2bf3154181247f8963be8cd31399851. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Getting quotas for user 539997e65f4f4ef7998a4386d19a5e9f and project e2bf3154181247f8963be8cd31399851. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:14:12 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:14:12 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-87757731-43de-443d-bf1a-5df699e24203 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.329292 Apr 24 00:14:12 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 57/180] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 24 00:14:11 2023] POST /compute/v2.1/servers => generated 399 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 24 00:14:12 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-71ea094c-4d94-44df-a476-531e8759e460 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:12 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-71ea094c-4d94-44df-a476-531e8759e460 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:12 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-71ea094c-4d94-44df-a476-531e8759e460 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:12 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-71ea094c-4d94-44df-a476-531e8759e460 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:12 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-71ea094c-4d94-44df-a476-531e8759e460 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:12 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-71ea094c-4d94-44df-a476-531e8759e460 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 200 len: 1275 microversion: 2.20 time: 0.100882 Apr 24 00:14:12 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 63/181] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:14:12 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:14:12 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-129a2119-86db-45a8-9bc7-7318fa9b3e70 req-ef0aa930-55bd-4818-abd1-e319d1ed0597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "name": "network-vif-plugged", "status": "completed", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:12 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-129a2119-86db-45a8-9bc7-7318fa9b3e70 req-ef0aa930-55bd-4818-abd1-e319d1ed0597 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:12 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-129a2119-86db-45a8-9bc7-7318fa9b3e70 req-ef0aa930-55bd-4818-abd1-e319d1ed0597 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:12 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-129a2119-86db-45a8-9bc7-7318fa9b3e70 req-ef0aa930-55bd-4818-abd1-e319d1ed0597 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:12 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-129a2119-86db-45a8-9bc7-7318fa9b3e70 req-ef0aa930-55bd-4818-abd1-e319d1ed0597 service nova] Creating event network-vif-plugged:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:14:12 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-129a2119-86db-45a8-9bc7-7318fa9b3e70 req-ef0aa930-55bd-4818-abd1-e319d1ed0597 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059486 Apr 24 00:14:12 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 62/182] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:16 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-acd1c835-dcfc-4043-b01d-e09db53d977b req-41e535f1-c1a5-4595-9cfd-8c5c27ef3b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:16 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-acd1c835-dcfc-4043-b01d-e09db53d977b req-41e535f1-c1a5-4595-9cfd-8c5c27ef3b8f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:16 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-acd1c835-dcfc-4043-b01d-e09db53d977b req-41e535f1-c1a5-4595-9cfd-8c5c27ef3b8f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:16 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-acd1c835-dcfc-4043-b01d-e09db53d977b req-41e535f1-c1a5-4595-9cfd-8c5c27ef3b8f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-acd1c835-dcfc-4043-b01d-e09db53d977b req-41e535f1-c1a5-4595-9cfd-8c5c27ef3b8f service nova] Creating event network-changed:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:14:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-acd1c835-dcfc-4043-b01d-e09db53d977b req-41e535f1-c1a5-4595-9cfd-8c5c27ef3b8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032474 Apr 24 00:14:16 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 58/183] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 24 00:14:19 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-9de6f21d-db25-429e-8c65-b6fed84af580 req-21fb96d2-a52d-4727-bb20-745ad1e7f686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "name": "network-vif-plugged", "status": "completed", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:19 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:19 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-9de6f21d-db25-429e-8c65-b6fed84af580 req-21fb96d2-a52d-4727-bb20-745ad1e7f686 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-9de6f21d-db25-429e-8c65-b6fed84af580 req-21fb96d2-a52d-4727-bb20-745ad1e7f686 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-9de6f21d-db25-429e-8c65-b6fed84af580 req-21fb96d2-a52d-4727-bb20-745ad1e7f686 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-9de6f21d-db25-429e-8c65-b6fed84af580 req-21fb96d2-a52d-4727-bb20-745ad1e7f686 service nova] Creating event network-vif-plugged:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:14:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-9de6f21d-db25-429e-8c65-b6fed84af580 req-21fb96d2-a52d-4727-bb20-745ad1e7f686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067940 Apr 24 00:14:19 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 64/184] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:21 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:21 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-17fbb5c6-5565-4571-a8b0-ed72807b279f req-666654ee-a652-49f3-a65d-d132a535a7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "name": "network-vif-plugged", "status": "completed", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-17fbb5c6-5565-4571-a8b0-ed72807b279f req-666654ee-a652-49f3-a65d-d132a535a7b6 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-17fbb5c6-5565-4571-a8b0-ed72807b279f req-666654ee-a652-49f3-a65d-d132a535a7b6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-17fbb5c6-5565-4571-a8b0-ed72807b279f req-666654ee-a652-49f3-a65d-d132a535a7b6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-17fbb5c6-5565-4571-a8b0-ed72807b279f req-666654ee-a652-49f3-a65d-d132a535a7b6 service nova] Creating event network-vif-plugged:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:14:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-17fbb5c6-5565-4571-a8b0-ed72807b279f req-666654ee-a652-49f3-a65d-d132a535a7b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032147 Apr 24 00:14:21 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 63/185] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-238075653", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461"}]}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] validate_networks() for [('52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for user 8d0ab07106dd4995aa7e3f5b6bc70e56 and project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:24 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:14:25 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:14:25 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-d365e8a8-c346-49f7-a8b4-5230eceea4f0 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.724341 Apr 24 00:14:25 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 59/186] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 24 00:14:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 24 00:14:25 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=16 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:25 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-7bbd4fac-c1ea-4c9c-9862-4905844a0da9 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:25 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-7bbd4fac-c1ea-4c9c-9862-4905844a0da9 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:25 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-7bbd4fac-c1ea-4c9c-9862-4905844a0da9 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:25 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-7bbd4fac-c1ea-4c9c-9862-4905844a0da9 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:25 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-7bbd4fac-c1ea-4c9c-9862-4905844a0da9 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:25 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-7bbd4fac-c1ea-4c9c-9862-4905844a0da9 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e" status: 200 len: 1394 microversion: 2.87 time: 0.076836 Apr 24 00:14:25 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 65/187] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:14:25 2023] GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e => generated 1394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:14:27 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-ffdc6fe3-3d70-4e7e-96f1-7403b2c61fa8 req-8762aacf-eb7c-4496-8cbb-0ecba68153c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e", "tag": "8cf3a870-6eaa-4c9c-8f70-d2324e755369"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ffdc6fe3-3d70-4e7e-96f1-7403b2c61fa8 req-8762aacf-eb7c-4496-8cbb-0ecba68153c7 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ffdc6fe3-3d70-4e7e-96f1-7403b2c61fa8 req-8762aacf-eb7c-4496-8cbb-0ecba68153c7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ffdc6fe3-3d70-4e7e-96f1-7403b2c61fa8 req-8762aacf-eb7c-4496-8cbb-0ecba68153c7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:27 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-ffdc6fe3-3d70-4e7e-96f1-7403b2c61fa8 req-8762aacf-eb7c-4496-8cbb-0ecba68153c7 service nova] Creating event network-changed:8cf3a870-6eaa-4c9c-8f70-d2324e755369 for instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e on user Apr 24 00:14:27 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-ffdc6fe3-3d70-4e7e-96f1-7403b2c61fa8 req-8762aacf-eb7c-4496-8cbb-0ecba68153c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032299 Apr 24 00:14:27 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 64/188] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:29 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-7ad5ddf4-6a36-42ee-b81b-bb980b10e91d req-393ada3d-ea92-4351-9549-596762d7e963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e", "name": "network-vif-deleted", "tag": "8cf3a870-6eaa-4c9c-8f70-d2324e755369"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:29 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-7ad5ddf4-6a36-42ee-b81b-bb980b10e91d req-393ada3d-ea92-4351-9549-596762d7e963 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:29 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-7ad5ddf4-6a36-42ee-b81b-bb980b10e91d req-393ada3d-ea92-4351-9549-596762d7e963 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:29 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-7ad5ddf4-6a36-42ee-b81b-bb980b10e91d req-393ada3d-ea92-4351-9549-596762d7e963 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:29 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.compute.server_external_events [req-7ad5ddf4-6a36-42ee-b81b-bb980b10e91d req-393ada3d-ea92-4351-9549-596762d7e963 service nova] Unable to find a host for instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e. Dropping event network-vif-deleted {{(pid=61491) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 24 00:14:29 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-7ad5ddf4-6a36-42ee-b81b-bb980b10e91d req-393ada3d-ea92-4351-9549-596762d7e963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029810 Apr 24 00:14:29 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 60/189] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:29 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:30 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640ec20e46a2422a8aabcc152e522e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0187dbb10d42da941645107df203f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:30 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-5ab22df8-7c1a-4044-85f6-94e64843f517 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426" status: 200 len: 1495 microversion: 2.1 time: 0.226966 Apr 24 00:14:30 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 66/190] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:30 2023] GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426 => generated 1495 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=15 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:35 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] HTTP exception thrown: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Request method failure captured: Apr 24 00:14:35 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 HTTP/1.1 Apr 24 00:14:35 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:14:35 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:14:35 user devstack@n-api.service[61493]: Connection: close Apr 24 00:14:35 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:14:35 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:14:35 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:14:35 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:14:35 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcklJy0gNk6PVsZoy3Z9supLgrztWjY3QFNQMGimnyaDplsgUweo6vnjnc0iEerpGJZb06digFQSgyE06GbukLAvfY4zbkP5F1NwHrZkrwhgA2x7u-2buB0BsO5bijbIfgkyw_VnGI_bjDPIotX5-LnMh3VtY1W4K4F3DzgEPppmwR4 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Project-Id: 6e163039cafd4b2880a41ded2e2f7d00 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e163039cafd4b2880a41ded2e2f7d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e163039cafd4b2880a41ded2e2f7d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e163039cafd4b2880a41ded2e2f7d00"}]}] Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Tenant-Id: 6e163039cafd4b2880a41ded2e2f7d00 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:35 user devstack@n-api.service[61493]: X-User: tempest-AttachSCSIVolumeTestJSON-1166211293-project-member Apr 24 00:14:35 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:14:35 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:14:35 user devstack@n-api.service[61493]: X-User-Id: 04625ea29ba641fc8342441f61274d4f Apr 24 00:14:35 user devstack@n-api.service[61493]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1166211293-project-member Apr 24 00:14:35 user devstack@n-api.service[61493]: method: > Apr 24 00:14:35 user devstack@n-api.service[61493]: exception: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:35 user devstack@n-api.service[61493]: action_args: {'id': '5e7bfc8d-7d4a-42f7-9657-cc65e1364b87'} Apr 24 00:14:35 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:35 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:35 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Returning 404 to user: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:14:35 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-74d3680e-9853-475e-b96f-c845f4d027a9 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 404 len: 111 microversion: 2.1 time: 0.036918 Apr 24 00:14:35 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:35 2023] GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:14:35 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-b58b1201-fef4-41ae-8f5e-ae7d46b0fbfe tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '.version_select at 0x7fc8c4e05b40>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:35 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:35 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:35 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:35 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-b58b1201-fef4-41ae-8f5e-ae7d46b0fbfe tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524659291" status: 202 len: 0 microversion: 2.1 time: 0.028960 Apr 24 00:14:35 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 61/192] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 24 00:14:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524659291 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:36 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] HTTP exception thrown: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Request method failure captured: Apr 24 00:14:36 user devstack@n-api.service[61492]: request: DELETE /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 HTTP/1.1 Apr 24 00:14:36 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:14:36 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:14:36 user devstack@n-api.service[61492]: Connection: close Apr 24 00:14:36 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:14:36 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:14:36 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:14:36 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:14:36 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcklJy0gNk6PVsZoy3Z9supLgrztWjY3QFNQMGimnyaDplsgUweo6vnjnc0iEerpGJZb06digFQSgyE06GbukLAvfY4zbkP5F1NwHrZkrwhgA2x7u-2buB0BsO5bijbIfgkyw_VnGI_bjDPIotX5-LnMh3VtY1W4K4F3DzgEPppmwR4 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Project-Id: 6e163039cafd4b2880a41ded2e2f7d00 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e163039cafd4b2880a41ded2e2f7d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e163039cafd4b2880a41ded2e2f7d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e163039cafd4b2880a41ded2e2f7d00"}]}] Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Tenant-Id: 6e163039cafd4b2880a41ded2e2f7d00 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:36 user devstack@n-api.service[61492]: X-User: tempest-AttachSCSIVolumeTestJSON-1166211293-project-member Apr 24 00:14:36 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:14:36 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:14:36 user devstack@n-api.service[61492]: X-User-Id: 04625ea29ba641fc8342441f61274d4f Apr 24 00:14:36 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1166211293-project-member Apr 24 00:14:36 user devstack@n-api.service[61492]: method: > Apr 24 00:14:36 user devstack@n-api.service[61492]: exception: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61492]: action_args: {'id': '5e7bfc8d-7d4a-42f7-9657-cc65e1364b87'} Apr 24 00:14:36 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Returning 404 to user: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:14:36 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-0143ae5d-b1ae-4dfd-8f43-9f583b0c103e tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 404 len: 111 microversion: 2.1 time: 0.032405 Apr 24 00:14:36 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 67/193] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:14:36 2023] DELETE /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] [instance: 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:36 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] HTTP exception thrown: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Request method failure captured: Apr 24 00:14:36 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 HTTP/1.1 Apr 24 00:14:36 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:14:36 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:14:36 user devstack@n-api.service[61493]: Connection: close Apr 24 00:14:36 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:14:36 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:14:36 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:14:36 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:14:36 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcklJy0gNk6PVsZoy3Z9supLgrztWjY3QFNQMGimnyaDplsgUweo6vnjnc0iEerpGJZb06digFQSgyE06GbukLAvfY4zbkP5F1NwHrZkrwhgA2x7u-2buB0BsO5bijbIfgkyw_VnGI_bjDPIotX5-LnMh3VtY1W4K4F3DzgEPppmwR4 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Project-Id: 6e163039cafd4b2880a41ded2e2f7d00 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e163039cafd4b2880a41ded2e2f7d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e163039cafd4b2880a41ded2e2f7d00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e163039cafd4b2880a41ded2e2f7d00"}]}] Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Tenant-Id: 6e163039cafd4b2880a41ded2e2f7d00 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1166211293 Apr 24 00:14:36 user devstack@n-api.service[61493]: X-User: tempest-AttachSCSIVolumeTestJSON-1166211293-project-member Apr 24 00:14:36 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:14:36 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:14:36 user devstack@n-api.service[61493]: X-User-Id: 04625ea29ba641fc8342441f61274d4f Apr 24 00:14:36 user devstack@n-api.service[61493]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1166211293-project-member Apr 24 00:14:36 user devstack@n-api.service[61493]: method: > Apr 24 00:14:36 user devstack@n-api.service[61493]: exception: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61493]: action_args: {'id': '5e7bfc8d-7d4a-42f7-9657-cc65e1364b87'} Apr 24 00:14:36 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. Apr 24 00:14:36 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:14:36 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] Returning 404 to user: Instance 5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:14:36 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-47c037d2-f3bc-4846-b24e-1e7d8e389a45 tempest-AttachSCSIVolumeTestJSON-1166211293 tempest-AttachSCSIVolumeTestJSON-1166211293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87" status: 404 len: 111 microversion: 2.1 time: 0.027101 Apr 24 00:14:36 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 66/194] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:36 2023] GET /compute/v2.1/servers/5e7bfc8d-7d4a-42f7-9657-cc65e1364b87 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:14:40 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=24 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:40 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-d1022dae-2e28-4c44-82d4-00a7ea182021 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Action: 'create', calling method: .version_select at 0x7fc8c38a0e50>, body: {"keypair": {"name": "tempest-keypair-1687889936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZwHgbIk6e428TAmz7l4fwQyTPgmH1ghkhtoPbQ0yUpoo/9gV6SJaSCP7G0NDgEplyQD28R6/mr35tsYyIgUkJf2JTlCo+FavLRnp0EzEd9fZ37x1cfd9aCy0pyr8ntuw=="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:40 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-d1022dae-2e28-4c44-82d4-00a7ea182021 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:40 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-d1022dae-2e28-4c44-82d4-00a7ea182021 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for user 35edcadbe77c4f4fa8304216e7f61d4a and project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:40 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-d1022dae-2e28-4c44-82d4-00a7ea182021 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174129 Apr 24 00:14:40 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 62/195] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:14:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-482287756", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1a83eb44-caaf-46ff-8823-be4580052b3f"}], "security_groups": [{"name": "tempest-securitygroup--444526388"}], "key_name": "tempest-keypair-1687889936", "user_data": "}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] validate_networks() for [('1a83eb44-caaf-46ff-8823-be4580052b3f', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for user 35edcadbe77c4f4fa8304216e7f61d4a and project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:14:42 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:14:43 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-22dfeae1-076b-416d-960a-70f97ac41ae2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.888314 Apr 24 00:14:43 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 68/196] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:14:42 2023] POST /compute/v2.1/servers => generated 399 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:14:43 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-765fa434-ffa4-4802-8b64-f47d4fe4f2a5 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:43 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-765fa434-ffa4-4802-8b64-f47d4fe4f2a5 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:43 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-765fa434-ffa4-4802-8b64-f47d4fe4f2a5 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:43 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-765fa434-ffa4-4802-8b64-f47d4fe4f2a5 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 200 len: 1235 microversion: 2.1 time: 0.101280 Apr 24 00:14:43 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 67/197] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:43 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 1235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:45 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-66054cd4-f972-493c-b321-c07726f254e1 req-a423375c-56cc-45d8-a767-ed77a5f6791c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-66054cd4-f972-493c-b321-c07726f254e1 req-a423375c-56cc-45d8-a767-ed77a5f6791c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-66054cd4-f972-493c-b321-c07726f254e1 req-a423375c-56cc-45d8-a767-ed77a5f6791c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:45 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-66054cd4-f972-493c-b321-c07726f254e1 req-a423375c-56cc-45d8-a767-ed77a5f6791c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:45 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-66054cd4-f972-493c-b321-c07726f254e1 req-a423375c-56cc-45d8-a767-ed77a5f6791c service nova] Creating event network-changed:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:14:45 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-66054cd4-f972-493c-b321-c07726f254e1 req-a423375c-56cc-45d8-a767-ed77a5f6791c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033300 Apr 24 00:14:45 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 63/198] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-19bd8b96-f263-4d2e-80f4-fcbbb9e7c599 req-0586d82d-8fee-4056-b17e-601eed956215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "name": "network-vif-plugged", "status": "completed", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-19bd8b96-f263-4d2e-80f4-fcbbb9e7c599 req-0586d82d-8fee-4056-b17e-601eed956215 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-19bd8b96-f263-4d2e-80f4-fcbbb9e7c599 req-0586d82d-8fee-4056-b17e-601eed956215 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-19bd8b96-f263-4d2e-80f4-fcbbb9e7c599 req-0586d82d-8fee-4056-b17e-601eed956215 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-19bd8b96-f263-4d2e-80f4-fcbbb9e7c599 req-0586d82d-8fee-4056-b17e-601eed956215 service nova] Creating event network-vif-plugged:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:14:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-19bd8b96-f263-4d2e-80f4-fcbbb9e7c599 req-0586d82d-8fee-4056-b17e-601eed956215 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Apr 24 00:14:47 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 69/199] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:49 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-31a691b6-5325-4fc9-b7b6-229712e820ff req-6d790fda-9512-4b49-9c80-cf90cb02f335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "name": "network-vif-plugged", "status": "completed", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:49 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:49 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-31a691b6-5325-4fc9-b7b6-229712e820ff req-6d790fda-9512-4b49-9c80-cf90cb02f335 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:49 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-31a691b6-5325-4fc9-b7b6-229712e820ff req-6d790fda-9512-4b49-9c80-cf90cb02f335 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:49 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-31a691b6-5325-4fc9-b7b6-229712e820ff req-6d790fda-9512-4b49-9c80-cf90cb02f335 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:49 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-31a691b6-5325-4fc9-b7b6-229712e820ff req-6d790fda-9512-4b49-9c80-cf90cb02f335 service nova] Creating event network-vif-plugged:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:14:50 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-31a691b6-5325-4fc9-b7b6-229712e820ff req-6d790fda-9512-4b49-9c80-cf90cb02f335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028415 Apr 24 00:14:50 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 68/200] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:52 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:52 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-a6cf33e2-9e3f-4d14-8b76-29fce981ad54 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 200 len: 1490 microversion: 2.1 time: 0.488698 Apr 24 00:14:52 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 64/201] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:52 2023] GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 1490 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:53 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:53 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:53 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-08f19245-09a0-49b6-a554-42d285c3f953 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Action: 'create', calling method: .version_select at 0x7fc8c370b6d0>, body: {"keypair": {"name": "tempest-keypair-1442678964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBH505bABPeY47tqqwKUNL0j9rZei8h+xMYLIM0SjTR/WY833MZWOzZDU3xf+eKarpT1DDNfoU7YX1pgGnkISVtzLfDBcBBJeM+PXJDnAxAnfo3AHLlU/Wx1vdEG2Tqyg=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:53 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-08f19245-09a0-49b6-a554-42d285c3f953 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Getting quotas for project 211ed190ee5c4a0b98b85960339ea437. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:53 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-08f19245-09a0-49b6-a554-42d285c3f953 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Getting quotas for user 8536b0b100af4c81b0114b37a10ec017 and project 211ed190ee5c4a0b98b85960339ea437. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:53 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-08f19245-09a0-49b6-a554-42d285c3f953 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174581 Apr 24 00:14:53 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 70/202] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:14:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:14:54 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-75602253", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "551bb188-8d6d-484a-813f-5f76f0ec0e85"}], "security_groups": [{"name": "tempest-securitygroup--1003632379"}], "key_name": "tempest-keypair-1442678964", "user_data": "}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:54 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] validate_networks() for [('551bb188-8d6d-484a-813f-5f76f0ec0e85', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Getting quotas for project 211ed190ee5c4a0b98b85960339ea437. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Getting quotas for user 8536b0b100af4c81b0114b37a10ec017 and project 211ed190ee5c4a0b98b85960339ea437. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:14:55 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:14:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-df9c089c-e22f-4894-a8d8-1cc2c58132f1 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.595311 Apr 24 00:14:55 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 69/203] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:14:54 2023] POST /compute/v2.1/servers => generated 407 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:14:55 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ba914797-3627-450d-9816-6cde2bde07f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:55 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-ba914797-3627-450d-9816-6cde2bde07f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:55 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-ba914797-3627-450d-9816-6cde2bde07f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:55 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-ba914797-3627-450d-9816-6cde2bde07f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1231 microversion: 2.1 time: 0.059399 Apr 24 00:14:55 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 65/204] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:55 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1231 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:55 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471d341199f0431a95ae54651c4f0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d063c2bdc884fb8b826b9fb6fd97405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:14:55 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-a5febe90-9668-4a51-a185-cc178f419803 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 200 len: 1535 microversion: 2.1 time: 0.251831 Apr 24 00:14:55 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 71/205] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:14:55 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 1535 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:14:57 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-082148f4-5c38-4a4a-a8ab-984b2f003a63 req-437d4fa3-1139-48d8-a102-696c757d7af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:14:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-082148f4-5c38-4a4a-a8ab-984b2f003a63 req-437d4fa3-1139-48d8-a102-696c757d7af9 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:14:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-082148f4-5c38-4a4a-a8ab-984b2f003a63 req-437d4fa3-1139-48d8-a102-696c757d7af9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:14:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-082148f4-5c38-4a4a-a8ab-984b2f003a63 req-437d4fa3-1139-48d8-a102-696c757d7af9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:14:57 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-082148f4-5c38-4a4a-a8ab-984b2f003a63 req-437d4fa3-1139-48d8-a102-696c757d7af9 service nova] Creating event network-changed:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:14:58 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-082148f4-5c38-4a4a-a8ab-984b2f003a63 req-437d4fa3-1139-48d8-a102-696c757d7af9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029246 Apr 24 00:14:58 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 70/206] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:14:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-f0a0c9a7-bb91-4554-8441-d129056c3286 req-3b954229-755a-43ad-8a1d-0970fa805ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-plugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-f0a0c9a7-bb91-4554-8441-d129056c3286 req-3b954229-755a-43ad-8a1d-0970fa805ec9 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-f0a0c9a7-bb91-4554-8441-d129056c3286 req-3b954229-755a-43ad-8a1d-0970fa805ec9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-f0a0c9a7-bb91-4554-8441-d129056c3286 req-3b954229-755a-43ad-8a1d-0970fa805ec9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-f0a0c9a7-bb91-4554-8441-d129056c3286 req-3b954229-755a-43ad-8a1d-0970fa805ec9 service nova] Creating event network-vif-plugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:15:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-f0a0c9a7-bb91-4554-8441-d129056c3286 req-3b954229-755a-43ad-8a1d-0970fa805ec9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061335 Apr 24 00:15:00 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 66/207] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-da97c8f6-9994-47ad-aea9-4a4a3637a26e req-2f29a694-ec71-4258-92ee-fe005d1b4b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-plugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-da97c8f6-9994-47ad-aea9-4a4a3637a26e req-2f29a694-ec71-4258-92ee-fe005d1b4b8b service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-da97c8f6-9994-47ad-aea9-4a4a3637a26e req-2f29a694-ec71-4258-92ee-fe005d1b4b8b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-da97c8f6-9994-47ad-aea9-4a4a3637a26e req-2f29a694-ec71-4258-92ee-fe005d1b4b8b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:02 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=19 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-da97c8f6-9994-47ad-aea9-4a4a3637a26e req-2f29a694-ec71-4258-92ee-fe005d1b4b8b service nova] Creating event network-vif-plugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:15:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-da97c8f6-9994-47ad-aea9-4a4a3637a26e req-2f29a694-ec71-4258-92ee-fe005d1b4b8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038950 Apr 24 00:15:02 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 72/208] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:02 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:03 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:03 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:03 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:03 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-2c9f9630-87a7-48d9-b19c-a32131e0b65b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 200 len: 1587 microversion: 2.20 time: 0.239273 Apr 24 00:15:03 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 71/209] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:15:02 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 1587 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:05 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Going to try to terminate instance {{(pid=61491) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:15:05 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-9069d4cd-47e7-469f-8357-ed5bf0d2943f tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 204 len: 0 microversion: 2.1 time: 0.129410 Apr 24 00:15:05 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 67/210] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:15:05 2023] DELETE /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:05 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:05 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-06fde124-e2c7-445d-9b8c-b5335e707e07 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 200 len: 1500 microversion: 2.1 time: 0.238147 Apr 24 00:15:05 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 73/211] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:05 2023] GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-404ee0d9-99e8-4ed5-b0e5-22f63a0ffd04 req-20537d46-847a-4b57-9608-14249578405f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1821ecf2-8c71-48ad-96da-f63b83439c6d", "name": "network-vif-unplugged", "status": "completed", "tag": "86355003-a71c-4c4f-9536-beab8f09ded2"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-404ee0d9-99e8-4ed5-b0e5-22f63a0ffd04 req-20537d46-847a-4b57-9608-14249578405f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-404ee0d9-99e8-4ed5-b0e5-22f63a0ffd04 req-20537d46-847a-4b57-9608-14249578405f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-404ee0d9-99e8-4ed5-b0e5-22f63a0ffd04 req-20537d46-847a-4b57-9608-14249578405f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-404ee0d9-99e8-4ed5-b0e5-22f63a0ffd04 req-20537d46-847a-4b57-9608-14249578405f service nova] Creating event network-vif-unplugged:86355003-a71c-4c4f-9536-beab8f09ded2 for instance 1821ecf2-8c71-48ad-96da-f63b83439c6d on user Apr 24 00:15:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-404ee0d9-99e8-4ed5-b0e5-22f63a0ffd04 req-20537d46-847a-4b57-9608-14249578405f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035906 Apr 24 00:15:05 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:07 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-29adbc7c-eec6-408b-b3a6-5b3df82fc4cc req-b8a8c96b-9e5b-4403-ad13-ef6d616efbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1821ecf2-8c71-48ad-96da-f63b83439c6d", "name": "network-vif-deleted", "tag": "86355003-a71c-4c4f-9536-beab8f09ded2"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:07 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:07 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-29adbc7c-eec6-408b-b3a6-5b3df82fc4cc req-b8a8c96b-9e5b-4403-ad13-ef6d616efbd3 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-29adbc7c-eec6-408b-b3a6-5b3df82fc4cc req-b8a8c96b-9e5b-4403-ad13-ef6d616efbd3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-29adbc7c-eec6-408b-b3a6-5b3df82fc4cc req-b8a8c96b-9e5b-4403-ad13-ef6d616efbd3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-29adbc7c-eec6-408b-b3a6-5b3df82fc4cc req-b8a8c96b-9e5b-4403-ad13-ef6d616efbd3 service nova] Creating event network-vif-deleted:86355003-a71c-4c4f-9536-beab8f09ded2 for instance 1821ecf2-8c71-48ad-96da-f63b83439c6d on user Apr 24 00:15:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-29adbc7c-eec6-408b-b3a6-5b3df82fc4cc req-b8a8c96b-9e5b-4403-ad13-ef6d616efbd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035223 Apr 24 00:15:07 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 68/213] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:07 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-42475c89-3084-4a2f-bcc9-9e55c2d462c8 req-96782808-6efe-4392-8263-ab6b5ce56894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1821ecf2-8c71-48ad-96da-f63b83439c6d", "name": "network-vif-plugged", "status": "completed", "tag": "86355003-a71c-4c4f-9536-beab8f09ded2"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:07 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-42475c89-3084-4a2f-bcc9-9e55c2d462c8 req-96782808-6efe-4392-8263-ab6b5ce56894 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-42475c89-3084-4a2f-bcc9-9e55c2d462c8 req-96782808-6efe-4392-8263-ab6b5ce56894 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-42475c89-3084-4a2f-bcc9-9e55c2d462c8 req-96782808-6efe-4392-8263-ab6b5ce56894 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:07 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-42475c89-3084-4a2f-bcc9-9e55c2d462c8 req-96782808-6efe-4392-8263-ab6b5ce56894 service nova] Creating event network-vif-plugged:86355003-a71c-4c4f-9536-beab8f09ded2 for instance 1821ecf2-8c71-48ad-96da-f63b83439c6d on user Apr 24 00:15:07 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-42475c89-3084-4a2f-bcc9-9e55c2d462c8 req-96782808-6efe-4392-8263-ab6b5ce56894 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034381 Apr 24 00:15:07 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 74/214] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG nova.objects.instance [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lazy-loading 'fault' on Instance uuid f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e {{(pid=61493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:15 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:15 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-25a8d975-93e8-425a-843c-53936928be83 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e" status: 200 len: 1649 microversion: 2.87 time: 0.160964 Apr 24 00:15:15 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 73/215] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:15:15 2023] GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e => generated 1649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Going to try to terminate instance {{(pid=61491) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Doing local delete in cell a345e55a-e119-441a-a250-b58384b04676(cell1) {{(pid=61491) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61491]: WARNING nova.compute.api [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] instance's host None is down, deleting from database Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] deallocate_for_instance() {{(pid=61491) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Instance cache missing network info. {{(pid=61491) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Updating instance_info_cache with network_info: [] {{(pid=61491) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 24 00:15:15 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61491) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 24 00:15:15 user devstack@n-api.service[61491]: WARNING nova.compute.api [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 24 00:15:15 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-7c880651-e368-42b2-a57b-56dd911f7f24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e" status: 204 len: 0 microversion: 2.87 time: 0.580037 Apr 24 00:15:15 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 69/216] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:15:15 2023] DELETE /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:15 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] HTTP exception thrown: Instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e could not be found. Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Request method failure captured: Apr 24 00:15:15 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e HTTP/1.1 Apr 24 00:15:15 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:15:15 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:15:15 user devstack@n-api.service[61492]: Connection: close Apr 24 00:15:15 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:15:15 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:15:15 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:15:15 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:15:15 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcks9jIUpJseB24-8cTq-FqbEDKIROUOEAF7JNU4Rnmey_q6uim9Me6xO25MvzT8gYSzs3B2QVrDC7uDGPpqmM1MBIiIHDJlC-Sbvh-FAY65lwcd_YYbyiLvEk6be4GT0CxJl1HJBeyWhjfIDMUzSd--u056bsfyKH5X-FZOyqRQm6g Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Openstack-Nova-Api-Version: 2.87 Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Project-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d26ba1ed4b9241f9a084db1a14a945bb"}]}] Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Tenant-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:15:15 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:15:15 user devstack@n-api.service[61492]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:15:15 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:15:15 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:15:15 user devstack@n-api.service[61492]: X-User-Id: 8d0ab07106dd4995aa7e3f5b6bc70e56 Apr 24 00:15:15 user devstack@n-api.service[61492]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:15:15 user devstack@n-api.service[61492]: method: > Apr 24 00:15:15 user devstack@n-api.service[61492]: exception: Instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e could not be found. Apr 24 00:15:15 user devstack@n-api.service[61492]: action_args: {'id': 'f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e'} Apr 24 00:15:15 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e could not be found. Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e could not be found. Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e could not be found. Apr 24 00:15:15 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:15:15 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Returning 404 to user: Instance f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:15:15 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-f70f376c-bf4f-409c-a710-ce1c20c4bf01 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e" status: 404 len: 111 microversion: 2.87 time: 0.033703 Apr 24 00:15:15 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 75/217] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:15:15 2023] GET /compute/v2.1/servers/f2eb4cbc-772c-4e6b-b0a1-4ab8378e841e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-515303589", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461"}]}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] validate_networks() for [('52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for user 8d0ab07106dd4995aa7e3f5b6bc70e56 and project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:15:16 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:15:16 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-36066562-5536-47c6-bf2d-ca546b35362a tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.610672 Apr 24 00:15:16 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 74/218] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 24 00:15:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 24 00:15:16 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-15571ed8-cdfc-49af-af09-dbdbc28446ed tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:16 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-15571ed8-cdfc-49af-af09-dbdbc28446ed tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:16 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-15571ed8-cdfc-49af-af09-dbdbc28446ed tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:16 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-15571ed8-cdfc-49af-af09-dbdbc28446ed tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:16 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-15571ed8-cdfc-49af-af09-dbdbc28446ed tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:16 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-15571ed8-cdfc-49af-af09-dbdbc28446ed tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d" status: 200 len: 1394 microversion: 2.87 time: 0.070672 Apr 24 00:15:16 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 70/219] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:15:16 2023] GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d => generated 1394 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:15:19 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-d673b6eb-72ad-48d6-b7d2-a0dbbcd51f7f req-2a93cd83-48c4-4e97-8ce8-7f2aef28423a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c91af3a-b837-4ff0-a236-3483ffe5277d", "tag": "7cef5b8b-d733-4f6a-8567-4b9e7e650fbb"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d673b6eb-72ad-48d6-b7d2-a0dbbcd51f7f req-2a93cd83-48c4-4e97-8ce8-7f2aef28423a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d673b6eb-72ad-48d6-b7d2-a0dbbcd51f7f req-2a93cd83-48c4-4e97-8ce8-7f2aef28423a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:19 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d673b6eb-72ad-48d6-b7d2-a0dbbcd51f7f req-2a93cd83-48c4-4e97-8ce8-7f2aef28423a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-d673b6eb-72ad-48d6-b7d2-a0dbbcd51f7f req-2a93cd83-48c4-4e97-8ce8-7f2aef28423a service nova] Creating event network-changed:7cef5b8b-d733-4f6a-8567-4b9e7e650fbb for instance 1c91af3a-b837-4ff0-a236-3483ffe5277d on user Apr 24 00:15:19 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-d673b6eb-72ad-48d6-b7d2-a0dbbcd51f7f req-2a93cd83-48c4-4e97-8ce8-7f2aef28423a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036062 Apr 24 00:15:19 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 76/220] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:21 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-f860c3c2-ee8a-4fda-ab61-c35ee73e8b24 req-2e6a735b-d26d-4cb6-b609-ea50fa9e997f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91af3a-b837-4ff0-a236-3483ffe5277d", "name": "network-vif-plugged", "status": "completed", "tag": "7cef5b8b-d733-4f6a-8567-4b9e7e650fbb"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-f860c3c2-ee8a-4fda-ab61-c35ee73e8b24 req-2e6a735b-d26d-4cb6-b609-ea50fa9e997f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-f860c3c2-ee8a-4fda-ab61-c35ee73e8b24 req-2e6a735b-d26d-4cb6-b609-ea50fa9e997f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:21 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-f860c3c2-ee8a-4fda-ab61-c35ee73e8b24 req-2e6a735b-d26d-4cb6-b609-ea50fa9e997f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:21 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=25 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-f860c3c2-ee8a-4fda-ab61-c35ee73e8b24 req-2e6a735b-d26d-4cb6-b609-ea50fa9e997f service nova] Creating event network-vif-plugged:7cef5b8b-d733-4f6a-8567-4b9e7e650fbb for instance 1c91af3a-b837-4ff0-a236-3483ffe5277d on user Apr 24 00:15:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-f860c3c2-ee8a-4fda-ab61-c35ee73e8b24 req-2e6a735b-d26d-4cb6-b609-ea50fa9e997f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047370 Apr 24 00:15:21 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:23 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-689f9281-91ca-4431-9f10-f1c973b301dc req-b04bf49a-6f5d-4696-a6f0-d5e1de47a4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91af3a-b837-4ff0-a236-3483ffe5277d", "name": "network-vif-plugged", "status": "completed", "tag": "7cef5b8b-d733-4f6a-8567-4b9e7e650fbb"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-689f9281-91ca-4431-9f10-f1c973b301dc req-b04bf49a-6f5d-4696-a6f0-d5e1de47a4b2 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-689f9281-91ca-4431-9f10-f1c973b301dc req-b04bf49a-6f5d-4696-a6f0-d5e1de47a4b2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-689f9281-91ca-4431-9f10-f1c973b301dc req-b04bf49a-6f5d-4696-a6f0-d5e1de47a4b2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:23 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-689f9281-91ca-4431-9f10-f1c973b301dc req-b04bf49a-6f5d-4696-a6f0-d5e1de47a4b2 service nova] Creating event network-vif-plugged:7cef5b8b-d733-4f6a-8567-4b9e7e650fbb for instance 1c91af3a-b837-4ff0-a236-3483ffe5277d on user Apr 24 00:15:23 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-689f9281-91ca-4431-9f10-f1c973b301dc req-b04bf49a-6f5d-4696-a6f0-d5e1de47a4b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039763 Apr 24 00:15:23 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 71/222] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=5 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=13 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:32 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:15:32 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-942b647b-3a46-44d3-a60e-0a03d1719b1f tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426" status: 204 len: 0 microversion: 2.1 time: 0.225357 Apr 24 00:15:32 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 77/223] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:15:32 2023] DELETE /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:32 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:32 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-ec29d3b1-5b17-4f70-8f7c-f814f72ece03 req-7832a4e4-39b4-47ee-93ea-b5a6fc20aae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a3766c-0a08-4eb5-a833-e39eb73d3426", "name": "network-vif-unplugged", "status": "completed", "tag": "5b300cf4-3c09-440b-8992-08ebf1a3d958"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:32 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ec29d3b1-5b17-4f70-8f7c-f814f72ece03 req-7832a4e4-39b4-47ee-93ea-b5a6fc20aae9 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:32 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ec29d3b1-5b17-4f70-8f7c-f814f72ece03 req-7832a4e4-39b4-47ee-93ea-b5a6fc20aae9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:32 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ec29d3b1-5b17-4f70-8f7c-f814f72ece03 req-7832a4e4-39b4-47ee-93ea-b5a6fc20aae9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:32 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-ec29d3b1-5b17-4f70-8f7c-f814f72ece03 req-7832a4e4-39b4-47ee-93ea-b5a6fc20aae9 service nova] Creating event network-vif-unplugged:5b300cf4-3c09-440b-8992-08ebf1a3d958 for instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 on user Apr 24 00:15:32 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-ec29d3b1-5b17-4f70-8f7c-f814f72ece03 req-7832a4e4-39b4-47ee-93ea-b5a6fc20aae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035508 Apr 24 00:15:32 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 72/224] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:32 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640ec20e46a2422a8aabcc152e522e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0187dbb10d42da941645107df203f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:32 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-7a32a29b-c056-4a17-aa17-21ca27cec0ee tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426" status: 200 len: 1501 microversion: 2.1 time: 0.246846 Apr 24 00:15:32 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 76/225] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:32 2023] GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426 => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:33 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:33 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-ebc8c0d6-0413-44ef-8d4f-e4de06ec6bfb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 200 len: 1543 microversion: 2.1 time: 0.444832 Apr 24 00:15:33 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 78/226] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:33 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 1543 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:33 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-1e4397f6-eeb6-44cf-9b39-cde21836d359 req-af92ee75-703d-4f37-87b7-02f5ac3c3b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a3766c-0a08-4eb5-a833-e39eb73d3426", "name": "network-vif-deleted", "tag": "5b300cf4-3c09-440b-8992-08ebf1a3d958"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:33 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-1e4397f6-eeb6-44cf-9b39-cde21836d359 req-af92ee75-703d-4f37-87b7-02f5ac3c3b3b service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:33 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-1e4397f6-eeb6-44cf-9b39-cde21836d359 req-af92ee75-703d-4f37-87b7-02f5ac3c3b3b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:33 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-1e4397f6-eeb6-44cf-9b39-cde21836d359 req-af92ee75-703d-4f37-87b7-02f5ac3c3b3b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:33 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-1e4397f6-eeb6-44cf-9b39-cde21836d359 req-af92ee75-703d-4f37-87b7-02f5ac3c3b3b service nova] Creating event network-vif-deleted:5b300cf4-3c09-440b-8992-08ebf1a3d958 for instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 on user Apr 24 00:15:33 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-1e4397f6-eeb6-44cf-9b39-cde21836d359 req-af92ee75-703d-4f37-87b7-02f5ac3c3b3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030006 Apr 24 00:15:33 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 73/227] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:34 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-9099e8cf-00c4-4de3-89bf-2dc6c8b13faa req-53c96b54-a4ae-4c3b-8b6b-eb451bf57cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a3766c-0a08-4eb5-a833-e39eb73d3426", "name": "network-vif-plugged", "status": "completed", "tag": "5b300cf4-3c09-440b-8992-08ebf1a3d958"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:34 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-9099e8cf-00c4-4de3-89bf-2dc6c8b13faa req-53c96b54-a4ae-4c3b-8b6b-eb451bf57cc2 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:34 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-9099e8cf-00c4-4de3-89bf-2dc6c8b13faa req-53c96b54-a4ae-4c3b-8b6b-eb451bf57cc2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:34 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-9099e8cf-00c4-4de3-89bf-2dc6c8b13faa req-53c96b54-a4ae-4c3b-8b6b-eb451bf57cc2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:34 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-9099e8cf-00c4-4de3-89bf-2dc6c8b13faa req-53c96b54-a4ae-4c3b-8b6b-eb451bf57cc2 service nova] Creating event network-vif-plugged:5b300cf4-3c09-440b-8992-08ebf1a3d958 for instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 on user Apr 24 00:15:34 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-9099e8cf-00c4-4de3-89bf-2dc6c8b13faa req-53c96b54-a4ae-4c3b-8b6b-eb451bf57cc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027189 Apr 24 00:15:34 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:45 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-251e9a93-e796-485b-9195-8db024bf1e5e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1538 microversion: 2.1 time: 0.241788 Apr 24 00:15:45 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 79/229] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:45 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1538 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:53 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:53 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-06cd55a6-70bb-488a-8eac-b72129c0e265 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32" status: 200 len: 1503 microversion: 2.1 time: 0.294490 Apr 24 00:15:53 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 74/230] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:52 2023] GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=8 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] HTTP exception thrown: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Request method failure captured: Apr 24 00:15:55 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d HTTP/1.1 Apr 24 00:15:55 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:15:55 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:15:55 user devstack@n-api.service[61493]: Connection: close Apr 24 00:15:55 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:15:55 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:15:55 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:15:55 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:15:55 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcknbEbJiLaFKm-Vp8fpFWaMYaeIMVlEum0rC_gcob1n4C2qD4-3OOTg19oE0ATJIKi-8M210PiwwRlLExga5iD7yuFvGLgT6t3N4tVMG-LbvilQDesbm_9IWJCRWoEzFQ2ZybiFE2hp3YXndKdLHaoMgduJRyPUK24AUWMYCvD2ZFI Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Project-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Project-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce75f63fc0904eceb03e8319bddba4d3"}]}] Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Tenant: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Tenant-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:15:55 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:15:55 user devstack@n-api.service[61493]: X-User: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:15:55 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:15:55 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:15:55 user devstack@n-api.service[61493]: X-User-Id: abae98323deb44dea0622186485cc7af Apr 24 00:15:55 user devstack@n-api.service[61493]: X-User-Name: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:15:55 user devstack@n-api.service[61493]: method: > Apr 24 00:15:55 user devstack@n-api.service[61493]: exception: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:15:55 user devstack@n-api.service[61493]: action_args: {'id': '1821ecf2-8c71-48ad-96da-f63b83439c6d'} Apr 24 00:15:55 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:15:55 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:15:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Returning 404 to user: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:15:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-d717be3b-4f2b-4a41-b6fc-c10c5cdc317d tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 404 len: 111 microversion: 2.1 time: 0.037912 Apr 24 00:15:55 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:55 2023] GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:55 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:55 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-e3ec5110-f41d-4f0f-b68d-e4d18413eeb1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1494 microversion: 2.1 time: 0.288377 Apr 24 00:15:55 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 80/232] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:55 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1494 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-5d0ddf37-e81d-4bb8-b887-c28bf05bcdc9 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.165958 Apr 24 00:15:56 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 75/233] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:15:56 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683/os-interface => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:56 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-4a8cc661-d5e5-482c-a7ac-77a8f8eddb39 req-6a82e9f5-52c1-4d83-ab3e-27622f0ffcde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-4a8cc661-d5e5-482c-a7ac-77a8f8eddb39 req-6a82e9f5-52c1-4d83-ab3e-27622f0ffcde service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-4a8cc661-d5e5-482c-a7ac-77a8f8eddb39 req-6a82e9f5-52c1-4d83-ab3e-27622f0ffcde service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-4a8cc661-d5e5-482c-a7ac-77a8f8eddb39 req-6a82e9f5-52c1-4d83-ab3e-27622f0ffcde service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:56 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-4a8cc661-d5e5-482c-a7ac-77a8f8eddb39 req-6a82e9f5-52c1-4d83-ab3e-27622f0ffcde service nova] Creating event network-changed:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:15:56 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-4a8cc661-d5e5-482c-a7ac-77a8f8eddb39 req-6a82e9f5-52c1-4d83-ab3e-27622f0ffcde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031075 Apr 24 00:15:56 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-36840552-4cd4-455e-b075-ad7ca2d82dfe tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683/ips" status: 200 len: 104 microversion: 2.1 time: 0.037382 Apr 24 00:15:56 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 81/235] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:15:56 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683/ips => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:58 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Going to try to terminate instance {{(pid=61491) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:15:58 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-f0e58108-e8d9-4fc4-8398-2071216bcbff tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 204 len: 0 microversion: 2.1 time: 0.126736 Apr 24 00:15:58 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 76/236] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:15:58 2023] DELETE /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:58 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-df49cea3-a8d3-40cb-8b32-3605cb146bf5 req-0eaaa617-62cf-4862-9837-edb8a603b306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "name": "network-vif-unplugged", "status": "completed", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:58 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-df49cea3-a8d3-40cb-8b32-3605cb146bf5 req-0eaaa617-62cf-4862-9837-edb8a603b306 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:58 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-df49cea3-a8d3-40cb-8b32-3605cb146bf5 req-0eaaa617-62cf-4862-9837-edb8a603b306 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:58 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-df49cea3-a8d3-40cb-8b32-3605cb146bf5 req-0eaaa617-62cf-4862-9837-edb8a603b306 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:15:58 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-df49cea3-a8d3-40cb-8b32-3605cb146bf5 req-0eaaa617-62cf-4862-9837-edb8a603b306 service nova] Creating event network-vif-unplugged:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:15:58 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-df49cea3-a8d3-40cb-8b32-3605cb146bf5 req-0eaaa617-62cf-4862-9837-edb8a603b306 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043879 Apr 24 00:15:58 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 82/237] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:15:58 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471d341199f0431a95ae54651c4f0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d063c2bdc884fb8b826b9fb6fd97405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:15:58 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-4dc3bfee-ff8c-45ba-b0fc-d989038103fa tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 200 len: 1660 microversion: 2.1 time: 0.344520 Apr 24 00:15:58 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:15:58 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 1660 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:15:59 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-b97ad9d6-eac5-4aef-bd6b-0f396082b1a8 req-24cae413-4bfe-4684-b26a-857211fff84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "name": "network-vif-deleted", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:15:59 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b97ad9d6-eac5-4aef-bd6b-0f396082b1a8 req-24cae413-4bfe-4684-b26a-857211fff84a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:15:59 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b97ad9d6-eac5-4aef-bd6b-0f396082b1a8 req-24cae413-4bfe-4684-b26a-857211fff84a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:15:59 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b97ad9d6-eac5-4aef-bd6b-0f396082b1a8 req-24cae413-4bfe-4684-b26a-857211fff84a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-b97ad9d6-eac5-4aef-bd6b-0f396082b1a8 req-24cae413-4bfe-4684-b26a-857211fff84a service nova] Creating event network-vif-deleted:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:16:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-b97ad9d6-eac5-4aef-bd6b-0f396082b1a8 req-24cae413-4bfe-4684-b26a-857211fff84a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048348 Apr 24 00:16:00 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 77/239] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:15:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:00 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-d52d3d01-258e-4d8f-a361-1e7b9b6cb4fc req-501353b1-6536-4f96-8592-f9368c3648c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c59ffc-494a-4d2b-a199-226a6e7cc683", "name": "network-vif-plugged", "status": "completed", "tag": "e9b64819-4e5d-4a42-aa9c-d460bb336094"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d52d3d01-258e-4d8f-a361-1e7b9b6cb4fc req-501353b1-6536-4f96-8592-f9368c3648c8 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d52d3d01-258e-4d8f-a361-1e7b9b6cb4fc req-501353b1-6536-4f96-8592-f9368c3648c8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-d52d3d01-258e-4d8f-a361-1e7b9b6cb4fc req-501353b1-6536-4f96-8592-f9368c3648c8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-d52d3d01-258e-4d8f-a361-1e7b9b6cb4fc req-501353b1-6536-4f96-8592-f9368c3648c8 service nova] Creating event network-vif-plugged:e9b64819-4e5d-4a42-aa9c-d460bb336094 for instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 on user Apr 24 00:16:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-d52d3d01-258e-4d8f-a361-1e7b9b6cb4fc req-501353b1-6536-4f96-8592-f9368c3648c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033482 Apr 24 00:16:00 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 83/240] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:03 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:03 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-4682345b-1927-4fe1-8570-369ca47c823b tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.160360 Apr 24 00:16:03 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 81/241] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 24 00:16:03 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:16:04 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-39b4fe7e-96d8-4047-b09f-589b96a5d4a3 req-46aafa1d-25e6-4c83-8082-7d1950d5eb86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-39b4fe7e-96d8-4047-b09f-589b96a5d4a3 req-46aafa1d-25e6-4c83-8082-7d1950d5eb86 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-39b4fe7e-96d8-4047-b09f-589b96a5d4a3 req-46aafa1d-25e6-4c83-8082-7d1950d5eb86 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:04 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-39b4fe7e-96d8-4047-b09f-589b96a5d4a3 req-46aafa1d-25e6-4c83-8082-7d1950d5eb86 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:04 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-39b4fe7e-96d8-4047-b09f-589b96a5d4a3 req-46aafa1d-25e6-4c83-8082-7d1950d5eb86 service nova] Creating event network-changed:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:16:04 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-39b4fe7e-96d8-4047-b09f-589b96a5d4a3 req-46aafa1d-25e6-4c83-8082-7d1950d5eb86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031613 Apr 24 00:16:04 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 78/242] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:04 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:04 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-1eef4d27-fe66-4dbe-bfe3-6103a32281dc tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a/ips" status: 200 len: 111 microversion: 2.20 time: 0.036819 Apr 24 00:16:04 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 84/243] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Apr 24 00:16:04 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a/ips => generated 111 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:05 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:16:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-f24bf9cd-99b5-4ff2-b836-5148b31fc362 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 204 len: 0 microversion: 2.20 time: 0.114868 Apr 24 00:16:05 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:16:05 2023] DELETE /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:05 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-a0f09388-b55a-4569-a8bd-6896c10172cd req-447b7870-24cb-4ec0-901e-69c409e50ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "name": "network-vif-unplugged", "status": "completed", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a0f09388-b55a-4569-a8bd-6896c10172cd req-447b7870-24cb-4ec0-901e-69c409e50ca4 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a0f09388-b55a-4569-a8bd-6896c10172cd req-447b7870-24cb-4ec0-901e-69c409e50ca4 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a0f09388-b55a-4569-a8bd-6896c10172cd req-447b7870-24cb-4ec0-901e-69c409e50ca4 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:05 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-a0f09388-b55a-4569-a8bd-6896c10172cd req-447b7870-24cb-4ec0-901e-69c409e50ca4 service nova] Creating event network-vif-unplugged:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:16:05 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-a0f09388-b55a-4569-a8bd-6896c10172cd req-447b7870-24cb-4ec0-901e-69c409e50ca4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031300 Apr 24 00:16:05 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 85/245] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:05 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:06 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:06 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '539997e65f4f4ef7998a4386d19a5e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bf3154181247f8963be8cd31399851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:06 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-01d6c01b-f53c-4833-8d18-58a2baf8b0b1 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 200 len: 1712 microversion: 2.20 time: 0.383380 Apr 24 00:16:06 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 79/246] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:16:05 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 1712 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:07 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:07 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:07 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:07 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-33594708-bc7f-4fe1-9a72-51f4073afb1e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d" status: 200 len: 1689 microversion: 2.87 time: 0.464480 Apr 24 00:16:07 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:16:06 2023] GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d => generated 1689 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:16:07 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-a7e8f22b-160f-4513-b308-6a87960af367 req-e1d37797-72d6-4e4a-857c-63ccd48a533a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "name": "network-vif-deleted", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a7e8f22b-160f-4513-b308-6a87960af367 req-e1d37797-72d6-4e4a-857c-63ccd48a533a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a7e8f22b-160f-4513-b308-6a87960af367 req-e1d37797-72d6-4e4a-857c-63ccd48a533a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:07 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a7e8f22b-160f-4513-b308-6a87960af367 req-e1d37797-72d6-4e4a-857c-63ccd48a533a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:07 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-a7e8f22b-160f-4513-b308-6a87960af367 req-e1d37797-72d6-4e4a-857c-63ccd48a533a service nova] Creating event network-vif-deleted:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:16:07 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-a7e8f22b-160f-4513-b308-6a87960af367 req-e1d37797-72d6-4e4a-857c-63ccd48a533a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034996 Apr 24 00:16:07 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 86/248] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:07 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-609126cb-f080-46fb-a4f6-b48423510032 req-5727f6ec-a540-4043-b5ee-b4a9e8322e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48c285-06f8-4d48-a550-c3fb3c05e93a", "name": "network-vif-plugged", "status": "completed", "tag": "44f2910d-d36a-479f-8fa0-f16f9a406765"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-609126cb-f080-46fb-a4f6-b48423510032 req-5727f6ec-a540-4043-b5ee-b4a9e8322e8c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-609126cb-f080-46fb-a4f6-b48423510032 req-5727f6ec-a540-4043-b5ee-b4a9e8322e8c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-609126cb-f080-46fb-a4f6-b48423510032 req-5727f6ec-a540-4043-b5ee-b4a9e8322e8c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-609126cb-f080-46fb-a4f6-b48423510032 req-5727f6ec-a540-4043-b5ee-b4a9e8322e8c service nova] Creating event network-vif-plugged:44f2910d-d36a-479f-8fa0-f16f9a406765 for instance eb48c285-06f8-4d48-a550-c3fb3c05e93a on user Apr 24 00:16:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-609126cb-f080-46fb-a4f6-b48423510032 req-5727f6ec-a540-4043-b5ee-b4a9e8322e8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028296 Apr 24 00:16:07 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 80/249] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: f2a3766c-0a08-4eb5-a833-e39eb73d3426] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:22 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] HTTP exception thrown: Instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 could not be found. Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Request method failure captured: Apr 24 00:16:22 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426 HTTP/1.1 Apr 24 00:16:22 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:16:22 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:16:22 user devstack@n-api.service[61493]: Connection: close Apr 24 00:16:22 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:16:22 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:16:22 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:16:22 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:16:22 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRckhqh1FK4CcT0nWdx3etGzLz0n50MXkT36A1t-eKU5R4npH6VJpM6kvaBDcHlSVwAL5ZScV51XSps5yZ-TfpbBQnnP1g0kUjjCMvWi35yUPoDH4zOIlPcXkywIi85El3LwgvVoKbB1r8mirHpdvJH_20da8xAjKtcMhheAVJ2TKq_I Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Project-Id: df0187dbb10d42da941645107df203f6 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Project-Name: tempest-VolumesAdminNegativeTest-821594302 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df0187dbb10d42da941645107df203f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df0187dbb10d42da941645107df203f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df0187dbb10d42da941645107df203f6"}]}] Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Tenant: tempest-VolumesAdminNegativeTest-821594302 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Tenant-Id: df0187dbb10d42da941645107df203f6 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-821594302 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-User: tempest-VolumesAdminNegativeTest-821594302-project-member Apr 24 00:16:22 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:16:22 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:16:22 user devstack@n-api.service[61493]: X-User-Id: 640ec20e46a2422a8aabcc152e522e02 Apr 24 00:16:22 user devstack@n-api.service[61493]: X-User-Name: tempest-VolumesAdminNegativeTest-821594302-project-member Apr 24 00:16:22 user devstack@n-api.service[61493]: method: > Apr 24 00:16:22 user devstack@n-api.service[61493]: exception: Instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 could not be found. Apr 24 00:16:22 user devstack@n-api.service[61493]: action_args: {'id': 'f2a3766c-0a08-4eb5-a833-e39eb73d3426'} Apr 24 00:16:22 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 could not be found. Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 could not be found. Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 could not be found. Apr 24 00:16:22 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:22 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Returning 404 to user: Instance f2a3766c-0a08-4eb5-a833-e39eb73d3426 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:22 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-6feb8d5f-cf0a-4ece-bea9-58dc7a10f4ea tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426" status: 404 len: 111 microversion: 2.1 time: 0.039036 Apr 24 00:16:22 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:22 2023] GET /compute/v2.1/servers/f2a3766c-0a08-4eb5-a833-e39eb73d3426 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=16 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=28 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:23 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:16:23 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-92bec28d-c367-4f39-a2cc-0999762e8dd4 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d" status: 204 len: 0 microversion: 2.1 time: 0.129688 Apr 24 00:16:23 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 87/251] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:16:23 2023] DELETE /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:23 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '640ec20e46a2422a8aabcc152e522e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0187dbb10d42da941645107df203f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:23 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-6cb6f261-f2e8-4593-b70f-98781ac4ed54 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d" status: 200 len: 1669 microversion: 2.1 time: 0.328082 Apr 24 00:16:23 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 81/252] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:23 2023] GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d => generated 1669 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:16:23 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-ee5a7f01-be71-47e8-8ab3-bf316dab6c50 req-0b6cff13-d461-4f51-83f8-c722b9cdb508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "name": "network-vif-unplugged", "status": "completed", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ee5a7f01-be71-47e8-8ab3-bf316dab6c50 req-0b6cff13-d461-4f51-83f8-c722b9cdb508 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ee5a7f01-be71-47e8-8ab3-bf316dab6c50 req-0b6cff13-d461-4f51-83f8-c722b9cdb508 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ee5a7f01-be71-47e8-8ab3-bf316dab6c50 req-0b6cff13-d461-4f51-83f8-c722b9cdb508 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:23 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-ee5a7f01-be71-47e8-8ab3-bf316dab6c50 req-0b6cff13-d461-4f51-83f8-c722b9cdb508 service nova] Creating event network-vif-unplugged:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:16:23 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-ee5a7f01-be71-47e8-8ab3-bf316dab6c50 req-0b6cff13-d461-4f51-83f8-c722b9cdb508 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027066 Apr 24 00:16:23 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:24 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-c05d7e07-dae8-478a-852c-6263027b0490 req-2f4c6a96-5512-49c3-9b2c-40d6ab35670a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "name": "network-vif-deleted", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c05d7e07-dae8-478a-852c-6263027b0490 req-2f4c6a96-5512-49c3-9b2c-40d6ab35670a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c05d7e07-dae8-478a-852c-6263027b0490 req-2f4c6a96-5512-49c3-9b2c-40d6ab35670a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:24 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c05d7e07-dae8-478a-852c-6263027b0490 req-2f4c6a96-5512-49c3-9b2c-40d6ab35670a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:24 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-c05d7e07-dae8-478a-852c-6263027b0490 req-2f4c6a96-5512-49c3-9b2c-40d6ab35670a service nova] Creating event network-vif-deleted:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:16:24 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-c05d7e07-dae8-478a-852c-6263027b0490 req-2f4c6a96-5512-49c3-9b2c-40d6ab35670a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036357 Apr 24 00:16:24 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 88/254] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:25 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-784c58fb-b646-4745-b3b6-4ecceb6654cf req-6b82aca9-ff5d-47c6-9f99-bbee10f53b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d", "name": "network-vif-plugged", "status": "completed", "tag": "d6f98d8d-f918-4aa5-abb0-a34e782f890a"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:25 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-784c58fb-b646-4745-b3b6-4ecceb6654cf req-6b82aca9-ff5d-47c6-9f99-bbee10f53b7d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:25 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-784c58fb-b646-4745-b3b6-4ecceb6654cf req-6b82aca9-ff5d-47c6-9f99-bbee10f53b7d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:25 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-784c58fb-b646-4745-b3b6-4ecceb6654cf req-6b82aca9-ff5d-47c6-9f99-bbee10f53b7d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:25 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-784c58fb-b646-4745-b3b6-4ecceb6654cf req-6b82aca9-ff5d-47c6-9f99-bbee10f53b7d service nova] Creating event network-vif-plugged:d6f98d8d-f918-4aa5-abb0-a34e782f890a for instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d on user Apr 24 00:16:25 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-784c58fb-b646-4745-b3b6-4ecceb6654cf req-6b82aca9-ff5d-47c6-9f99-bbee10f53b7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 Apr 24 00:16:25 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 82/255] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:33 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:33 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3ded9e85-f145-4822-abe4-e8736ffd6bac tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.157844 Apr 24 00:16:33 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:16:33 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3/os-interface => generated 282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:34 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:34 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:34 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-0c0d990b-49fb-464f-8f4e-07d8e7a22e6f req-85f91419-f7cd-4a67-86b2-eba32fd68a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0c0d990b-49fb-464f-8f4e-07d8e7a22e6f req-85f91419-f7cd-4a67-86b2-eba32fd68a0d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0c0d990b-49fb-464f-8f4e-07d8e7a22e6f req-85f91419-f7cd-4a67-86b2-eba32fd68a0d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-0c0d990b-49fb-464f-8f4e-07d8e7a22e6f req-85f91419-f7cd-4a67-86b2-eba32fd68a0d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:34 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-0c0d990b-49fb-464f-8f4e-07d8e7a22e6f req-85f91419-f7cd-4a67-86b2-eba32fd68a0d service nova] Creating event network-changed:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:16:34 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-0c0d990b-49fb-464f-8f4e-07d8e7a22e6f req-85f91419-f7cd-4a67-86b2-eba32fd68a0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094276 Apr 24 00:16:34 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 89/257] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:34 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-22af0b87-6b28-4220-b175-4570d0f98817 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3/ips" status: 200 len: 107 microversion: 2.1 time: 0.041513 Apr 24 00:16:34 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 83/258] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:16:34 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3/ips => generated 107 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:36 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:16:36 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-0d46dbbe-67fc-4c29-b661-fff97be797f2 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 204 len: 0 microversion: 2.1 time: 0.109028 Apr 24 00:16:36 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:16:36 2023] DELETE /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:36 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:36 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-1d89899b-acf8-499c-854c-20347e529510 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 200 len: 1668 microversion: 2.1 time: 0.260756 Apr 24 00:16:36 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 90/260] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:36 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:16:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "name": "network-vif-unplugged", "status": "completed", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}, {"server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "name": "network-vif-plugged", "status": "completed", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] Creating event network-vif-unplugged:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:16:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] Creating event network-vif-plugged:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:16:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-f5cfbbf4-92a7-4a36-83a8-2ae4f56d9ead req-41f23baa-407f-483d-82f2-4c35b37cad5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031420 Apr 24 00:16:36 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 84/261] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:36 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:38 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-a0699300-482a-4aa5-bbdb-db447e666aff req-efdd6e69-bf2e-4a90-8a0f-41250fbe0406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f004f3-9b3f-4388-88a8-8eb663ba36a3", "name": "network-vif-deleted", "tag": "389e432f-0336-45fe-b2ff-4ba1ac63e0f3"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-a0699300-482a-4aa5-bbdb-db447e666aff req-efdd6e69-bf2e-4a90-8a0f-41250fbe0406 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-a0699300-482a-4aa5-bbdb-db447e666aff req-efdd6e69-bf2e-4a90-8a0f-41250fbe0406 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-a0699300-482a-4aa5-bbdb-db447e666aff req-efdd6e69-bf2e-4a90-8a0f-41250fbe0406 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:39 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-a0699300-482a-4aa5-bbdb-db447e666aff req-efdd6e69-bf2e-4a90-8a0f-41250fbe0406 service nova] Creating event network-vif-deleted:389e432f-0336-45fe-b2ff-4ba1ac63e0f3 for instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 on user Apr 24 00:16:39 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-a0699300-482a-4aa5-bbdb-db447e666aff req-efdd6e69-bf2e-4a90-8a0f-41250fbe0406 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028453 Apr 24 00:16:39 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:46 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:46 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-4437ef82-6747-45cd-9c13-dd90ab552ae0 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.182737 Apr 24 00:16:46 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 91/263] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:16:45 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a/os-interface => generated 282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-6464f7c0-91de-4b20-bf4f-264d9cf476f3 req-6f05fc81-14ca-4b26-b180-517056e7ccf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-6464f7c0-91de-4b20-bf4f-264d9cf476f3 req-6f05fc81-14ca-4b26-b180-517056e7ccf7 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-6464f7c0-91de-4b20-bf4f-264d9cf476f3 req-6f05fc81-14ca-4b26-b180-517056e7ccf7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-6464f7c0-91de-4b20-bf4f-264d9cf476f3 req-6f05fc81-14ca-4b26-b180-517056e7ccf7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-6464f7c0-91de-4b20-bf4f-264d9cf476f3 req-6f05fc81-14ca-4b26-b180-517056e7ccf7 service nova] Creating event network-changed:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:16:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-6464f7c0-91de-4b20-bf4f-264d9cf476f3 req-6f05fc81-14ca-4b26-b180-517056e7ccf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036585 Apr 24 00:16:46 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 85/264] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:46 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:47 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:47 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-d46d7f1f-72a1-421b-9f6c-f8e00f80043a tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1538 microversion: 2.1 time: 0.213602 Apr 24 00:16:47 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:46 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1538 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:47 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-b8977ed5-50d3-4bff-8cf9-ef1b06d057e3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1538 microversion: 2.1 time: 0.218961 Apr 24 00:16:47 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 92/266] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:47 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1538 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:48 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] HTTP exception thrown: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Request method failure captured: Apr 24 00:16:48 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 HTTP/1.1 Apr 24 00:16:48 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:16:48 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:16:48 user devstack@n-api.service[61491]: Connection: close Apr 24 00:16:48 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:16:48 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:16:48 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:16:48 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:16:48 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRckZu1BgVOzfEZDzJ2-HCTuZbCBukUCL8fhgRaQH1vFvil_nfiLiz-gd1UT9LTv8cnRLdw2HZoSFJ6hICCJLxpq4Tn4eqp8L1CSstH_lKlmvt2lahP0J94yS8F-vCxf7YQT6sNiQPQWtt_G47t9RL-JyPAdhmproCEMOpki5QWNiKR0 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Project-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d063c2bdc884fb8b826b9fb6fd97405"}]}] Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Tenant-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:48 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:16:48 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:16:48 user devstack@n-api.service[61491]: X-User-Id: 471d341199f0431a95ae54651c4f0780 Apr 24 00:16:48 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:48 user devstack@n-api.service[61491]: method: > Apr 24 00:16:48 user devstack@n-api.service[61491]: exception: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:48 user devstack@n-api.service[61491]: action_args: {'id': '38c59ffc-494a-4d2b-a199-226a6e7cc683'} Apr 24 00:16:48 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:48 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:48 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Returning 404 to user: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:48 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-8d6fa536-964a-43c2-a4f5-00250864b28e tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 404 len: 111 microversion: 2.1 time: 0.132453 Apr 24 00:16:48 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 86/267] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:48 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:16:48 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-118c1954-0f5b-4c26-a5a4-58220153d78b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '.version_select at 0x7fc8c38afd90>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-118c1954-0f5b-4c26-a5a4-58220153d78b tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-670582452" status: 202 len: 0 microversion: 2.1 time: 0.021883 Apr 24 00:16:48 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 90/268] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 24 00:16:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-670582452 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:49 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] HTTP exception thrown: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Request method failure captured: Apr 24 00:16:49 user devstack@n-api.service[61492]: request: DELETE /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 HTTP/1.1 Apr 24 00:16:49 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:16:49 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:16:49 user devstack@n-api.service[61492]: Connection: close Apr 24 00:16:49 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:16:49 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:16:49 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:16:49 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:16:49 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRckZu1BgVOzfEZDzJ2-HCTuZbCBukUCL8fhgRaQH1vFvil_nfiLiz-gd1UT9LTv8cnRLdw2HZoSFJ6hICCJLxpq4Tn4eqp8L1CSstH_lKlmvt2lahP0J94yS8F-vCxf7YQT6sNiQPQWtt_G47t9RL-JyPAdhmproCEMOpki5QWNiKR0 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Project-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d063c2bdc884fb8b826b9fb6fd97405"}]}] Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Tenant-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:49 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:16:49 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:16:49 user devstack@n-api.service[61492]: X-User-Id: 471d341199f0431a95ae54651c4f0780 Apr 24 00:16:49 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:49 user devstack@n-api.service[61492]: method: > Apr 24 00:16:49 user devstack@n-api.service[61492]: exception: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61492]: action_args: {'id': '38c59ffc-494a-4d2b-a199-226a6e7cc683'} Apr 24 00:16:49 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Returning 404 to user: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:49 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-5bd8da66-12fd-4a7f-aef1-86d810926be1 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 404 len: 111 microversion: 2.1 time: 0.044519 Apr 24 00:16:49 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 93/269] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:16:49 2023] DELETE /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 38c59ffc-494a-4d2b-a199-226a6e7cc683] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:49 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] HTTP exception thrown: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Request method failure captured: Apr 24 00:16:49 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 HTTP/1.1 Apr 24 00:16:49 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:16:49 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:16:49 user devstack@n-api.service[61491]: Connection: close Apr 24 00:16:49 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:16:49 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:16:49 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:16:49 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:16:49 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRckZu1BgVOzfEZDzJ2-HCTuZbCBukUCL8fhgRaQH1vFvil_nfiLiz-gd1UT9LTv8cnRLdw2HZoSFJ6hICCJLxpq4Tn4eqp8L1CSstH_lKlmvt2lahP0J94yS8F-vCxf7YQT6sNiQPQWtt_G47t9RL-JyPAdhmproCEMOpki5QWNiKR0 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Project-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d063c2bdc884fb8b826b9fb6fd97405"}]}] Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Tenant-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:49 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:16:49 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:16:49 user devstack@n-api.service[61491]: X-User-Id: 471d341199f0431a95ae54651c4f0780 Apr 24 00:16:49 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:49 user devstack@n-api.service[61491]: method: > Apr 24 00:16:49 user devstack@n-api.service[61491]: exception: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61491]: action_args: {'id': '38c59ffc-494a-4d2b-a199-226a6e7cc683'} Apr 24 00:16:49 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. Apr 24 00:16:49 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:49 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Returning 404 to user: Instance 38c59ffc-494a-4d2b-a199-226a6e7cc683 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:49 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-43a9890d-7f38-49b6-ab02-3ee44ba644b5 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683" status: 404 len: 111 microversion: 2.1 time: 0.034211 Apr 24 00:16:49 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 87/270] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:49 2023] GET /compute/v2.1/servers/38c59ffc-494a-4d2b-a199-226a6e7cc683 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:50 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] HTTP exception thrown: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Request method failure captured: Apr 24 00:16:50 user devstack@n-api.service[61493]: request: DELETE /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 HTTP/1.1 Apr 24 00:16:50 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:16:50 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:16:50 user devstack@n-api.service[61493]: Connection: close Apr 24 00:16:50 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:16:50 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:16:50 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:16:50 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:16:50 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRckZu1BgVOzfEZDzJ2-HCTuZbCBukUCL8fhgRaQH1vFvil_nfiLiz-gd1UT9LTv8cnRLdw2HZoSFJ6hICCJLxpq4Tn4eqp8L1CSstH_lKlmvt2lahP0J94yS8F-vCxf7YQT6sNiQPQWtt_G47t9RL-JyPAdhmproCEMOpki5QWNiKR0 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Project-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Project-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d063c2bdc884fb8b826b9fb6fd97405"}]}] Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Tenant: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Tenant-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-User: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:50 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:16:50 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:16:50 user devstack@n-api.service[61493]: X-User-Id: 471d341199f0431a95ae54651c4f0780 Apr 24 00:16:50 user devstack@n-api.service[61493]: X-User-Name: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:50 user devstack@n-api.service[61493]: method: > Apr 24 00:16:50 user devstack@n-api.service[61493]: exception: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61493]: action_args: {'id': '212a2ad6-77ab-4615-b6ca-f426a3e76ab5'} Apr 24 00:16:50 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Returning 404 to user: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:50 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-f91d529f-c3db-46c9-8a12-a0905df0b6ae tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 404 len: 111 microversion: 2.1 time: 0.033012 Apr 24 00:16:50 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:16:50 2023] DELETE /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] [instance: 212a2ad6-77ab-4615-b6ca-f426a3e76ab5] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:50 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] HTTP exception thrown: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Request method failure captured: Apr 24 00:16:50 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 HTTP/1.1 Apr 24 00:16:50 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:16:50 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:16:50 user devstack@n-api.service[61492]: Connection: close Apr 24 00:16:50 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:16:50 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:16:50 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:16:50 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:16:50 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRckZu1BgVOzfEZDzJ2-HCTuZbCBukUCL8fhgRaQH1vFvil_nfiLiz-gd1UT9LTv8cnRLdw2HZoSFJ6hICCJLxpq4Tn4eqp8L1CSstH_lKlmvt2lahP0J94yS8F-vCxf7YQT6sNiQPQWtt_G47t9RL-JyPAdhmproCEMOpki5QWNiKR0 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Project-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d063c2bdc884fb8b826b9fb6fd97405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d063c2bdc884fb8b826b9fb6fd97405"}]}] Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Tenant-Id: 1d063c2bdc884fb8b826b9fb6fd97405 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425553791 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:50 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:16:50 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:16:50 user devstack@n-api.service[61492]: X-User-Id: 471d341199f0431a95ae54651c4f0780 Apr 24 00:16:50 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeTestJSON-1425553791-project-member Apr 24 00:16:50 user devstack@n-api.service[61492]: method: > Apr 24 00:16:50 user devstack@n-api.service[61492]: exception: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61492]: action_args: {'id': '212a2ad6-77ab-4615-b6ca-f426a3e76ab5'} Apr 24 00:16:50 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. Apr 24 00:16:50 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:50 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] Returning 404 to user: Instance 212a2ad6-77ab-4615-b6ca-f426a3e76ab5 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:50 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8f20b958-9dbb-4be4-b101-ccb05b747ff3 tempest-AttachVolumeTestJSON-1425553791 tempest-AttachVolumeTestJSON-1425553791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5" status: 404 len: 111 microversion: 2.1 time: 0.036394 Apr 24 00:16:50 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 94/272] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:50 2023] GET /compute/v2.1/servers/212a2ad6-77ab-4615-b6ca-f426a3e76ab5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=15 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=21 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:16:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] HTTP exception thrown: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Request method failure captured: Apr 24 00:16:56 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a HTTP/1.1 Apr 24 00:16:56 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:16:56 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:16:56 user devstack@n-api.service[61491]: Connection: close Apr 24 00:16:56 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:16:56 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:16:56 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:16:56 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:16:56 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcklAS5hyOYy4tT_9HvV5K5wTiPJaxw9epmIdyPPJNLz5oj9K4JTKsMqNaxJVwuyPqad2YXU0myPv_bU2opvofTJHh4Lo39aUi3WKca85jp_WHQ4FS-HeMCIl7s6-nVoVaKloSKdkHHoqy8KO__Q4iSXMeYB6rfavinVqtISTsOUmIM Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Openstack-Nova-Api-Version: 2.20 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Project-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e2bf3154181247f8963be8cd31399851"}]}] Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Tenant-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:56 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:56 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:16:56 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:16:56 user devstack@n-api.service[61491]: X-User-Id: 539997e65f4f4ef7998a4386d19a5e9f Apr 24 00:16:56 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:56 user devstack@n-api.service[61491]: method: > Apr 24 00:16:56 user devstack@n-api.service[61491]: exception: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:56 user devstack@n-api.service[61491]: action_args: {'id': 'eb48c285-06f8-4d48-a550-c3fb3c05e93a'} Apr 24 00:16:56 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Returning 404 to user: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-a0faaf73-f923-40e8-94f9-41f963c6033e tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 404 len: 111 microversion: 2.20 time: 0.198726 Apr 24 00:16:56 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 88/273] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:16:56 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:16:56 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-32b40034-5b6a-466d-a233-05ea67010e99 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '.version_select at 0x7fc8c3709090>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-32b40034-5b6a-466d-a233-05ea67010e99 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058824653" status: 204 len: 0 microversion: 2.20 time: 0.027421 Apr 24 00:16:56 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-6a5fc73c-fb6e-4cec-9bb0-acf2eda73fe5 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 204 len: 0 microversion: 2.1 time: 0.120787 Apr 24 00:16:56 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 95/274] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Apr 24 00:16:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058824653 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:16:56 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 92/275] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:16:56 2023] DELETE /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-c0c0f74b-5bea-43b9-90f0-02582800407f tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 200 len: 1496 microversion: 2.1 time: 0.517716 Apr 24 00:16:56 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 89/276] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:56 2023] GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 1496 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:16:56 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-2dd766f6-9524-49fb-a446-e9b5c2ff4e3b req-8315e96a-e887-48e9-a5f3-34292d09a468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-unplugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-2dd766f6-9524-49fb-a446-e9b5c2ff4e3b req-8315e96a-e887-48e9-a5f3-34292d09a468 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-2dd766f6-9524-49fb-a446-e9b5c2ff4e3b req-8315e96a-e887-48e9-a5f3-34292d09a468 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-2dd766f6-9524-49fb-a446-e9b5c2ff4e3b req-8315e96a-e887-48e9-a5f3-34292d09a468 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-2dd766f6-9524-49fb-a446-e9b5c2ff4e3b req-8315e96a-e887-48e9-a5f3-34292d09a468 service nova] Creating event network-vif-unplugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:16:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-2dd766f6-9524-49fb-a446-e9b5c2ff4e3b req-8315e96a-e887-48e9-a5f3-34292d09a468 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189359 Apr 24 00:16:56 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 96/277] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] HTTP exception thrown: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Request method failure captured: Apr 24 00:16:57 user devstack@n-api.service[61491]: request: DELETE /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a HTTP/1.1 Apr 24 00:16:57 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:16:57 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:16:57 user devstack@n-api.service[61491]: Connection: close Apr 24 00:16:57 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:16:57 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:16:57 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:16:57 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:16:57 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcklAS5hyOYy4tT_9HvV5K5wTiPJaxw9epmIdyPPJNLz5oj9K4JTKsMqNaxJVwuyPqad2YXU0myPv_bU2opvofTJHh4Lo39aUi3WKca85jp_WHQ4FS-HeMCIl7s6-nVoVaKloSKdkHHoqy8KO__Q4iSXMeYB6rfavinVqtISTsOUmIM Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Openstack-Nova-Api-Version: 2.20 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e2bf3154181247f8963be8cd31399851"}]}] Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Tenant-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Id: 539997e65f4f4ef7998a4386d19a5e9f Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61491]: method: > Apr 24 00:16:57 user devstack@n-api.service[61491]: exception: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: action_args: {'id': 'eb48c285-06f8-4d48-a550-c3fb3c05e93a'} Apr 24 00:16:57 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Returning 404 to user: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-785fb296-f6a2-4ba0-8961-2024d35f42d7 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 404 len: 111 microversion: 2.20 time: 0.029674 Apr 24 00:16:57 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 90/278] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:16:57 2023] DELETE /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: eb48c285-06f8-4d48-a550-c3fb3c05e93a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] HTTP exception thrown: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Request method failure captured: Apr 24 00:16:57 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a HTTP/1.1 Apr 24 00:16:57 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:16:57 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:16:57 user devstack@n-api.service[61492]: Connection: close Apr 24 00:16:57 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:16:57 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:16:57 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:16:57 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:16:57 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcklAS5hyOYy4tT_9HvV5K5wTiPJaxw9epmIdyPPJNLz5oj9K4JTKsMqNaxJVwuyPqad2YXU0myPv_bU2opvofTJHh4Lo39aUi3WKca85jp_WHQ4FS-HeMCIl7s6-nVoVaKloSKdkHHoqy8KO__Q4iSXMeYB6rfavinVqtISTsOUmIM Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Openstack-Nova-Api-Version: 2.20 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e2bf3154181247f8963be8cd31399851"}]}] Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Tenant-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Id: 539997e65f4f4ef7998a4386d19a5e9f Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61492]: method: > Apr 24 00:16:57 user devstack@n-api.service[61492]: exception: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: action_args: {'id': 'eb48c285-06f8-4d48-a550-c3fb3c05e93a'} Apr 24 00:16:57 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Returning 404 to user: Instance eb48c285-06f8-4d48-a550-c3fb3c05e93a could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-bc2dacf7-c336-4e66-acff-9a62974737f4 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a" status: 404 len: 111 microversion: 2.20 time: 0.031795 Apr 24 00:16:57 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 97/279] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:16:57 2023] GET /compute/v2.1/servers/eb48c285-06f8-4d48-a550-c3fb3c05e93a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] HTTP exception thrown: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Request method failure captured: Apr 24 00:16:57 user devstack@n-api.service[61491]: request: DELETE /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 HTTP/1.1 Apr 24 00:16:57 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:16:57 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:16:57 user devstack@n-api.service[61491]: Connection: close Apr 24 00:16:57 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:16:57 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:16:57 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:16:57 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:16:57 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcklAS5hyOYy4tT_9HvV5K5wTiPJaxw9epmIdyPPJNLz5oj9K4JTKsMqNaxJVwuyPqad2YXU0myPv_bU2opvofTJHh4Lo39aUi3WKca85jp_WHQ4FS-HeMCIl7s6-nVoVaKloSKdkHHoqy8KO__Q4iSXMeYB6rfavinVqtISTsOUmIM Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Openstack-Nova-Api-Version: 2.20 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e2bf3154181247f8963be8cd31399851"}]}] Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Tenant-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Id: 539997e65f4f4ef7998a4386d19a5e9f Apr 24 00:16:57 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61491]: method: > Apr 24 00:16:57 user devstack@n-api.service[61491]: exception: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: action_args: {'id': 'e762c863-43e1-4f26-ab6b-c8ea40f08887'} Apr 24 00:16:57 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Returning 404 to user: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-aedd32a2-0576-4bc4-8056-24e8f89dc591 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 404 len: 111 microversion: 2.20 time: 0.040962 Apr 24 00:16:57 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 91/280] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:16:57 2023] DELETE /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] [instance: e762c863-43e1-4f26-ab6b-c8ea40f08887] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:16:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] HTTP exception thrown: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Request method failure captured: Apr 24 00:16:57 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 HTTP/1.1 Apr 24 00:16:57 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:16:57 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:16:57 user devstack@n-api.service[61492]: Connection: close Apr 24 00:16:57 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:16:57 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:16:57 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:16:57 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:16:57 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcklAS5hyOYy4tT_9HvV5K5wTiPJaxw9epmIdyPPJNLz5oj9K4JTKsMqNaxJVwuyPqad2YXU0myPv_bU2opvofTJHh4Lo39aUi3WKca85jp_WHQ4FS-HeMCIl7s6-nVoVaKloSKdkHHoqy8KO__Q4iSXMeYB6rfavinVqtISTsOUmIM Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Openstack-Nova-Api-Version: 2.20 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e2bf3154181247f8963be8cd31399851"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e2bf3154181247f8963be8cd31399851"}]}] Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Tenant-Id: e2bf3154181247f8963be8cd31399851 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947115496 Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Id: 539997e65f4f4ef7998a4386d19a5e9f Apr 24 00:16:57 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947115496-project-member Apr 24 00:16:57 user devstack@n-api.service[61492]: method: > Apr 24 00:16:57 user devstack@n-api.service[61492]: exception: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: action_args: {'id': 'e762c863-43e1-4f26-ab6b-c8ea40f08887'} Apr 24 00:16:57 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. Apr 24 00:16:57 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:16:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] Returning 404 to user: Instance e762c863-43e1-4f26-ab6b-c8ea40f08887 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:16:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8024085c-ee56-495b-a6eb-7da1a1d68708 tempest-AttachVolumeShelveTestJSON-1947115496 tempest-AttachVolumeShelveTestJSON-1947115496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887" status: 404 len: 111 microversion: 2.20 time: 0.041984 Apr 24 00:16:57 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 98/281] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:16:57 2023] GET /compute/v2.1/servers/e762c863-43e1-4f26-ab6b-c8ea40f08887 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:16:57 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-f9dc686f-24c2-4b8e-b7c4-f4e34064bbf1 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1494 microversion: 2.1 time: 0.347099 Apr 24 00:16:57 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:16:57 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-e3b7528f-0a77-463a-91a2-8d37a8781ddf req-24793757-8606-4ca4-9a43-348ad7cf5e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-deleted", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-e3b7528f-0a77-463a-91a2-8d37a8781ddf req-24793757-8606-4ca4-9a43-348ad7cf5e23 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-e3b7528f-0a77-463a-91a2-8d37a8781ddf req-24793757-8606-4ca4-9a43-348ad7cf5e23 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-e3b7528f-0a77-463a-91a2-8d37a8781ddf req-24793757-8606-4ca4-9a43-348ad7cf5e23 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-e3b7528f-0a77-463a-91a2-8d37a8781ddf req-24793757-8606-4ca4-9a43-348ad7cf5e23 service nova] Creating event network-vif-deleted:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:16:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-e3b7528f-0a77-463a-91a2-8d37a8781ddf req-24793757-8606-4ca4-9a43-348ad7cf5e23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050220 Apr 24 00:16:57 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 92/283] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:16:58 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-8f93deec-9253-475b-942d-a0e300656463 req-a40e2293-4c72-4df6-90c2-8068d3bca09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a14b79-7792-4962-bbe1-ec11e10e6948", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4aa76-4861-41fe-a0dc-5dee747b2517"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:16:58 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-8f93deec-9253-475b-942d-a0e300656463 req-a40e2293-4c72-4df6-90c2-8068d3bca09f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:16:58 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-8f93deec-9253-475b-942d-a0e300656463 req-a40e2293-4c72-4df6-90c2-8068d3bca09f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:16:58 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-8f93deec-9253-475b-942d-a0e300656463 req-a40e2293-4c72-4df6-90c2-8068d3bca09f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:16:58 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-8f93deec-9253-475b-942d-a0e300656463 req-a40e2293-4c72-4df6-90c2-8068d3bca09f service nova] Creating event network-vif-plugged:fbd4aa76-4861-41fe-a0dc-5dee747b2517 for instance f1a14b79-7792-4962-bbe1-ec11e10e6948 on user Apr 24 00:16:58 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-8f93deec-9253-475b-942d-a0e300656463 req-a40e2293-4c72-4df6-90c2-8068d3bca09f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041784 Apr 24 00:16:58 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 99/284] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:16:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-32971201"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:07 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:08 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-cf5e3676-2394-4f05-81d5-c6143eb1eb24 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d/action" status: 202 len: 52 microversion: 2.87 time: 1.184346 Apr 24 00:17:08 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 94/285] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 24 00:17:07 2023] POST /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d/action => generated 52 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=9 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=13 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=30 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:13 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] [instance: dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:13 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] HTTP exception thrown: Instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d could not be found. Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Request method failure captured: Apr 24 00:17:13 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d HTTP/1.1 Apr 24 00:17:13 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:17:13 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:17:13 user devstack@n-api.service[61491]: Connection: close Apr 24 00:17:13 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:17:13 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:17:13 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:17:13 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:17:13 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRckhqh1FK4CcT0nWdx3etGzLz0n50MXkT36A1t-eKU5R4npH6VJpM6kvaBDcHlSVwAL5ZScV51XSps5yZ-TfpbBQnnP1g0kUjjCMvWi35yUPoDH4zOIlPcXkywIi85El3LwgvVoKbB1r8mirHpdvJH_20da8xAjKtcMhheAVJ2TKq_I Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Project-Id: df0187dbb10d42da941645107df203f6 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Project-Name: tempest-VolumesAdminNegativeTest-821594302 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df0187dbb10d42da941645107df203f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df0187dbb10d42da941645107df203f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df0187dbb10d42da941645107df203f6"}]}] Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Tenant: tempest-VolumesAdminNegativeTest-821594302 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Tenant-Id: df0187dbb10d42da941645107df203f6 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-821594302 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-User: tempest-VolumesAdminNegativeTest-821594302-project-member Apr 24 00:17:13 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:17:13 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:17:13 user devstack@n-api.service[61491]: X-User-Id: 640ec20e46a2422a8aabcc152e522e02 Apr 24 00:17:13 user devstack@n-api.service[61491]: X-User-Name: tempest-VolumesAdminNegativeTest-821594302-project-member Apr 24 00:17:13 user devstack@n-api.service[61491]: method: > Apr 24 00:17:13 user devstack@n-api.service[61491]: exception: Instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d could not be found. Apr 24 00:17:13 user devstack@n-api.service[61491]: action_args: {'id': 'dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d'} Apr 24 00:17:13 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d could not be found. Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d could not be found. Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d could not be found. Apr 24 00:17:13 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:13 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Returning 404 to user: Instance dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:17:13 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-39a5a67e-c2ab-44c4-ae89-ededd566821d tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d" status: 404 len: 111 microversion: 2.1 time: 0.292603 Apr 24 00:17:13 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 93/286] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:13 2023] GET /compute/v2.1/servers/dae014b2-b56f-4e0f-8c1e-12b05d9c5b3d => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:17:13 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-5bfcd709-b749-40a6-94aa-14ec6299dbb5 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] Calling method '.version_select at 0x7fc8c38aca60>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:13 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-5bfcd709-b749-40a6-94aa-14ec6299dbb5 tempest-VolumesAdminNegativeTest-821594302 tempest-VolumesAdminNegativeTest-821594302-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324105185" status: 202 len: 0 microversion: 2.1 time: 0.025426 Apr 24 00:17:13 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 24 00:17:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324105185 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:17:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:14 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:14 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8d7f1d89-5dd3-46b7-a32c-2482d7a43638 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d" status: 200 len: 1689 microversion: 2.87 time: 0.263201 Apr 24 00:17:14 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 100/288] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:17:13 2023] GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:26 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:17:26 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 HTTP/1.1 Apr 24 00:17:26 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:17:26 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:17:26 user devstack@n-api.service[61491]: Connection: close Apr 24 00:17:26 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:17:26 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:17:26 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:17:26 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:17:26 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:17:26 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:17:26 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:17:26 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:17:26 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:17:26 user devstack@n-api.service[61491]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:17:26 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:17:26 user devstack@n-api.service[61491]: method: > Apr 24 00:17:26 user devstack@n-api.service[61491]: exception: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:17:26 user devstack@n-api.service[61491]: action_args: {'id': '43f004f3-9b3f-4388-88a8-8eb663ba36a3'} Apr 24 00:17:26 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:17:26 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:26 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:17:26 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-ef199d0f-ff89-4189-a1f9-8a496c8651cb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 404 len: 111 microversion: 2.1 time: 0.036628 Apr 24 00:17:26 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 94/289] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:26 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:17:26 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:26 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:26 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3e67fdc5-bc61-4795-95f1-6238c90011a1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '.version_select at 0x7fc8c3738ca0>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:26 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3e67fdc5-bc61-4795-95f1-6238c90011a1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687889936" status: 202 len: 0 microversion: 2.1 time: 0.027158 Apr 24 00:17:26 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 96/290] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 24 00:17:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687889936 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:17:27 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-33367d79-1c37-400d-b3a5-35542b891f24 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3709b40>, body: {"keypair": {"name": "tempest-keypair-669922603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9ANefNai0/rsSQaIoE6MwpNZsPCDJ1hAlE0Sqe0cS0k9aiWxLvZOvWrAlWMxkgj6Ru1wbGkR0RjHJCL/oloMLQjvQ7osVNQYPYNqwz8q0ZbFbyL90CnzPAEEVrQST+9A=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:27 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:27 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:27 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-33367d79-1c37-400d-b3a5-35542b891f24 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:17:27 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-33367d79-1c37-400d-b3a5-35542b891f24 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for user 35edcadbe77c4f4fa8304216e7f61d4a and project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:17:27 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-33367d79-1c37-400d-b3a5-35542b891f24 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052323 Apr 24 00:17:27 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 101/291] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:17:27 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:29 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-313901605", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1a83eb44-caaf-46ff-8823-be4580052b3f"}], "security_groups": [{"name": "tempest-securitygroup--405971613"}], "key_name": "tempest-keypair-669922603", "user_data": "}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:29 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] validate_networks() for [('1a83eb44-caaf-46ff-8823-be4580052b3f', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for user 35edcadbe77c4f4fa8304216e7f61d4a and project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:17:30 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:17:30 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-d7904e52-2962-4d04-8b78-12b41418ec86 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.044618 Apr 24 00:17:30 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 95/292] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:17:29 2023] POST /compute/v2.1/servers => generated 399 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:17:30 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-dc7b6b4b-a015-4bc9-9297-39c44ad6ad9d tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:30 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-dc7b6b4b-a015-4bc9-9297-39c44ad6ad9d tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:30 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-dc7b6b4b-a015-4bc9-9297-39c44ad6ad9d tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:30 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-dc7b6b4b-a015-4bc9-9297-39c44ad6ad9d tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 200 len: 1234 microversion: 2.1 time: 0.079591 Apr 24 00:17:30 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:30 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 1234 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:17:35 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-934b6c81-b90b-4912-ae9b-0e1d73ead335 req-bd79c87d-3a15-4333-ad75-079f717a2a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:35 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-934b6c81-b90b-4912-ae9b-0e1d73ead335 req-bd79c87d-3a15-4333-ad75-079f717a2a3d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:35 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-934b6c81-b90b-4912-ae9b-0e1d73ead335 req-bd79c87d-3a15-4333-ad75-079f717a2a3d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:35 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-934b6c81-b90b-4912-ae9b-0e1d73ead335 req-bd79c87d-3a15-4333-ad75-079f717a2a3d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:35 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-934b6c81-b90b-4912-ae9b-0e1d73ead335 req-bd79c87d-3a15-4333-ad75-079f717a2a3d service nova] Creating event network-changed:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:17:35 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-934b6c81-b90b-4912-ae9b-0e1d73ead335 req-bd79c87d-3a15-4333-ad75-079f717a2a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033908 Apr 24 00:17:35 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 102/294] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:37 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-ef873aa5-fff9-4b93-aa22-c6b424a7dd81 req-8159c682-cd75-44c8-9c50-6159bbdedffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "name": "network-vif-plugged", "status": "completed", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ef873aa5-fff9-4b93-aa22-c6b424a7dd81 req-8159c682-cd75-44c8-9c50-6159bbdedffe service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ef873aa5-fff9-4b93-aa22-c6b424a7dd81 req-8159c682-cd75-44c8-9c50-6159bbdedffe service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-ef873aa5-fff9-4b93-aa22-c6b424a7dd81 req-8159c682-cd75-44c8-9c50-6159bbdedffe service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:37 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-ef873aa5-fff9-4b93-aa22-c6b424a7dd81 req-8159c682-cd75-44c8-9c50-6159bbdedffe service nova] Creating event network-vif-plugged:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:17:37 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-ef873aa5-fff9-4b93-aa22-c6b424a7dd81 req-8159c682-cd75-44c8-9c50-6159bbdedffe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044017 Apr 24 00:17:37 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 98/295] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:37 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:37 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-16956a25-2ca4-4a50-9c45-c926ff13bfe5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.434420 Apr 24 00:17:37 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 96/296] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:37 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:38 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-c6906abf-d437-4677-9ac3-65f9337dc501 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.256198 Apr 24 00:17:38 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 103/297] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:37 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:17:39 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-0aeb867e-97e6-4f79-88cd-45c06ab8d800 req-05ce2afa-7cd1-44d3-8bb4-30d7a145383b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "name": "network-vif-plugged", "status": "completed", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:39 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0aeb867e-97e6-4f79-88cd-45c06ab8d800 req-05ce2afa-7cd1-44d3-8bb4-30d7a145383b service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:39 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0aeb867e-97e6-4f79-88cd-45c06ab8d800 req-05ce2afa-7cd1-44d3-8bb4-30d7a145383b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:39 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0aeb867e-97e6-4f79-88cd-45c06ab8d800 req-05ce2afa-7cd1-44d3-8bb4-30d7a145383b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:39 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-0aeb867e-97e6-4f79-88cd-45c06ab8d800 req-05ce2afa-7cd1-44d3-8bb4-30d7a145383b service nova] Creating event network-vif-plugged:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:17:39 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-0aeb867e-97e6-4f79-88cd-45c06ab8d800 req-05ce2afa-7cd1-44d3-8bb4-30d7a145383b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039982 Apr 24 00:17:39 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 99/298] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:43 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:43 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:43 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-1f1e9c53-6db8-4d85-9442-0b65fb61d65b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3766cb0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1799058279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeZP0p0lwKvXDXvuW52XwDq3F/jdLDEwtvJVwiOp4OTfyWXeIMaaEAMfG/SE3qJxELt/agLszkPj+lhygv4s0kc0XNWg8aaRmcCvDGrSOIMb1gh5CpK3xvghy/XTnLEEA=="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:43 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-1f1e9c53-6db8-4d85-9442-0b65fb61d65b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Getting quotas for project 9011aa88afdb40f4be4c2e9846fa72dd. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:17:43 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-1f1e9c53-6db8-4d85-9442-0b65fb61d65b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Getting quotas for user 4192d379850d40c5b684d8835548acd5 and project 9011aa88afdb40f4be4c2e9846fa72dd. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:17:43 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-1f1e9c53-6db8-4d85-9442-0b65fb61d65b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.249873 Apr 24 00:17:43 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 97/299] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:17:43 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:44 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1538855312", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1799058279", "security_groups": [{"name": "tempest-secgroup-smoke-1782409981"}], "networks": [{"uuid": "13deae10-040e-47ec-a868-0cd1b10e09e1"}]}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:44 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] validate_networks() for [('13deae10-040e-47ec-a868-0cd1b10e09e1', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Getting quotas for project 9011aa88afdb40f4be4c2e9846fa72dd. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Getting quotas for user 4192d379850d40c5b684d8835548acd5 and project 9011aa88afdb40f4be4c2e9846fa72dd. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:17:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:17:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-838de810-ce42-454c-b2da-ea73f7fe9ccc tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.782076 Apr 24 00:17:45 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 104/300] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:17:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:17:45 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:45 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3073e15d-bc90-4897-84b4-d3fffa1a5464 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:45 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-3073e15d-bc90-4897-84b4-d3fffa1a5464 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:45 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-3073e15d-bc90-4897-84b4-d3fffa1a5464 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4192d379850d40c5b684d8835548acd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9011aa88afdb40f4be4c2e9846fa72dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:45 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3073e15d-bc90-4897-84b4-d3fffa1a5464 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9" status: 200 len: 1257 microversion: 2.1 time: 0.106772 Apr 24 00:17:45 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 100/301] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:45 2023] GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 => generated 1257 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: f1a14b79-7792-4962-bbe1-ec11e10e6948] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] HTTP exception thrown: Instance f1a14b79-7792-4962-bbe1-ec11e10e6948 could not be found. Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Request method failure captured: Apr 24 00:17:47 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 HTTP/1.1 Apr 24 00:17:47 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:17:47 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:17:47 user devstack@n-api.service[61491]: Connection: close Apr 24 00:17:47 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:17:47 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:17:47 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:17:47 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:17:47 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRclYqXT7PnV_uWVZ5U2zU-dcQF-R3UDRQk_-qBfs4_T8qLs5P3_mxfy9nxywsKezgZp4JqYsLyUUFaz6LKyz31ZbmZdwlqVEwJ3F25fNbKYGV1h41xGCA-Jspa-zm4OH-cL-k2LK7GcmlnfPBNHvoORXEFyFBwmWLn7Rr18qpCyB8Ak Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Project-Id: 5cff0cbf3a5c4a4aadb3399a31adff0d Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487575741 Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cff0cbf3a5c4a4aadb3399a31adff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cff0cbf3a5c4a4aadb3399a31adff0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5cff0cbf3a5c4a4aadb3399a31adff0d"}]}] Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487575741 Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Tenant-Id: 5cff0cbf3a5c4a4aadb3399a31adff0d Apr 24 00:17:47 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487575741 Apr 24 00:17:47 user devstack@n-api.service[61491]: X-User: tempest-ServerRescueNegativeTestJSON-487575741-project-member Apr 24 00:17:47 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:17:47 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:17:47 user devstack@n-api.service[61491]: X-User-Id: 514ecffec8034d60ae3c00ecd1ef5c8b Apr 24 00:17:47 user devstack@n-api.service[61491]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487575741-project-member Apr 24 00:17:47 user devstack@n-api.service[61491]: method: > Apr 24 00:17:47 user devstack@n-api.service[61491]: exception: Instance f1a14b79-7792-4962-bbe1-ec11e10e6948 could not be found. Apr 24 00:17:47 user devstack@n-api.service[61491]: action_args: {'id': 'f1a14b79-7792-4962-bbe1-ec11e10e6948'} Apr 24 00:17:47 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a14b79-7792-4962-bbe1-ec11e10e6948 could not be found. Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a14b79-7792-4962-bbe1-ec11e10e6948 could not be found. Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a14b79-7792-4962-bbe1-ec11e10e6948 could not be found. Apr 24 00:17:47 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Returning 404 to user: Instance f1a14b79-7792-4962-bbe1-ec11e10e6948 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:17:47 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-0b38873c-fe50-44c0-8e4d-68c3cba6d008 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948" status: 404 len: 111 microversion: 2.1 time: 0.202372 Apr 24 00:17:47 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 98/302] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:46 2023] GET /compute/v2.1/servers/f1a14b79-7792-4962-bbe1-ec11e10e6948 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:17:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-4bb971ca-f830-4780-9d69-555283b7387b tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32" status: 204 len: 0 microversion: 2.1 time: 0.110324 Apr 24 00:17:47 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 105/303] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:17:47 2023] DELETE /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '514ecffec8034d60ae3c00ecd1ef5c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cff0cbf3a5c4a4aadb3399a31adff0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:47 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-2fe3a3d1-2559-4caa-8a36-d86927e153a8 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32" status: 200 len: 1509 microversion: 2.1 time: 0.441244 Apr 24 00:17:47 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 101/304] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:47 2023] GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32 => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-fe440427-21b0-4a6c-a719-eba26602f40a req-d7ad1241-d088-46cc-9585-68624eba8515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac38bbc2-2229-4497-b501-e9230ec59a32", "name": "network-vif-unplugged", "status": "completed", "tag": "b716ea04-c5e7-43fc-9f20-5ecb011d6385"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-fe440427-21b0-4a6c-a719-eba26602f40a req-d7ad1241-d088-46cc-9585-68624eba8515 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-fe440427-21b0-4a6c-a719-eba26602f40a req-d7ad1241-d088-46cc-9585-68624eba8515 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-fe440427-21b0-4a6c-a719-eba26602f40a req-d7ad1241-d088-46cc-9585-68624eba8515 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:47 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-fe440427-21b0-4a6c-a719-eba26602f40a req-d7ad1241-d088-46cc-9585-68624eba8515 service nova] Creating event network-vif-unplugged:b716ea04-c5e7-43fc-9f20-5ecb011d6385 for instance ac38bbc2-2229-4497-b501-e9230ec59a32 on user Apr 24 00:17:47 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-fe440427-21b0-4a6c-a719-eba26602f40a req-d7ad1241-d088-46cc-9585-68624eba8515 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129653 Apr 24 00:17:47 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 99/305] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:48 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-1a9058fd-f93a-4aa8-bffc-502c72f76968 req-08d743de-47f3-4459-8303-9e467138b1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1728a086-3a73-4157-8c2f-3606820448a9", "tag": "1d88c88b-4db7-4078-b68a-941a4a4e7920"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:48 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-1a9058fd-f93a-4aa8-bffc-502c72f76968 req-08d743de-47f3-4459-8303-9e467138b1f0 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:48 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-1a9058fd-f93a-4aa8-bffc-502c72f76968 req-08d743de-47f3-4459-8303-9e467138b1f0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:48 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-1a9058fd-f93a-4aa8-bffc-502c72f76968 req-08d743de-47f3-4459-8303-9e467138b1f0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:48 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-1a9058fd-f93a-4aa8-bffc-502c72f76968 req-08d743de-47f3-4459-8303-9e467138b1f0 service nova] Creating event network-changed:1d88c88b-4db7-4078-b68a-941a4a4e7920 for instance 1728a086-3a73-4157-8c2f-3606820448a9 on user Apr 24 00:17:48 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-1a9058fd-f93a-4aa8-bffc-502c72f76968 req-08d743de-47f3-4459-8303-9e467138b1f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030674 Apr 24 00:17:48 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 106/306] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:49 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac38bbc2-2229-4497-b501-e9230ec59a32", "name": "network-vif-plugged", "status": "completed", "tag": "b716ea04-c5e7-43fc-9f20-5ecb011d6385"}, {"server_uuid": "ac38bbc2-2229-4497-b501-e9230ec59a32", "name": "network-vif-deleted", "tag": "b716ea04-c5e7-43fc-9f20-5ecb011d6385"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:49 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:49 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:49 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:49 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] Creating event network-vif-plugged:b716ea04-c5e7-43fc-9f20-5ecb011d6385 for instance ac38bbc2-2229-4497-b501-e9230ec59a32 on user Apr 24 00:17:49 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] Creating event network-vif-deleted:b716ea04-c5e7-43fc-9f20-5ecb011d6385 for instance ac38bbc2-2229-4497-b501-e9230ec59a32 on user Apr 24 00:17:49 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-c5776224-fd21-43b0-a938-b441cbe8afa6 req-ca14d39c-5a23-4bee-9171-c8c9213d7c65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030432 Apr 24 00:17:49 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 102/307] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:51 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1728a086-3a73-4157-8c2f-3606820448a9", "name": "network-vif-plugged", "status": "completed", "tag": "1d88c88b-4db7-4078-b68a-941a4a4e7920"}, {"server_uuid": "1728a086-3a73-4157-8c2f-3606820448a9", "name": "network-vif-plugged", "status": "completed", "tag": "1d88c88b-4db7-4078-b68a-941a4a4e7920"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:17:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:51 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] Creating event network-vif-plugged:1d88c88b-4db7-4078-b68a-941a4a4e7920 for instance 1728a086-3a73-4157-8c2f-3606820448a9 on user Apr 24 00:17:51 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] Creating event network-vif-plugged:1d88c88b-4db7-4078-b68a-941a4a4e7920 for instance 1728a086-3a73-4157-8c2f-3606820448a9 on user Apr 24 00:17:51 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-796a3cc7-2dea-4e7d-b07e-8dddaceccaf8 req-cb780c5b-8e0d-44f2-8676-db94a213d8e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030803 Apr 24 00:17:51 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 100/308] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:17:57 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:17:58 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:17:58 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-22582d2f-b98e-4d6c-896d-762f314b01fc tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1494 microversion: 2.1 time: 0.407564 Apr 24 00:17:58 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 107/309] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:17:57 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:18:03 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:03 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:03 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=12 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:03 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3bf909d5-9206-4ae3-a9fe-cfc92865b1d4 tempest-TestStampPattern-988815498 tempest-TestStampPattern-988815498-project-member] Action: 'create', calling method: .version_select at 0x7fc8c38ae3b0>, body: {"keypair": {"name": "tempest-TestStampPattern-1630980562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHh2F3+iE9v6j8uAzEGsVE1dGmzzOM319DHl5oQaR9MtB+21/YpblyubON+4hp5Nax/I8gLbx0oYjiIDGGUihE8mMwZoqE70O7sgTcmzUbjW+C997P07Od7BnXlSnR8q1w=="}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:18:03 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-3bf909d5-9206-4ae3-a9fe-cfc92865b1d4 tempest-TestStampPattern-988815498 tempest-TestStampPattern-988815498-project-member] Getting quotas for project 9188fe3228ab4b7bb067879867ba1c76. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:18:03 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-3bf909d5-9206-4ae3-a9fe-cfc92865b1d4 tempest-TestStampPattern-988815498 tempest-TestStampPattern-988815498-project-member] Getting quotas for user f80aa3207a5345bcbc52c1c34b665fdb and project 9188fe3228ab4b7bb067879867ba1c76. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:18:03 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3bf909d5-9206-4ae3-a9fe-cfc92865b1d4 tempest-TestStampPattern-988815498 tempest-TestStampPattern-988815498-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.258978 Apr 24 00:18:03 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 103/310] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:18:03 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:18:06 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:06 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:06 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=16 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:06 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-550a1f23-906f-478d-a5bb-ea7ee984675b tempest-TestStampPattern-988815498 tempest-TestStampPattern-988815498-project-member] Calling method '.version_select at 0x7fc8c3766710>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:06 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-550a1f23-906f-478d-a5bb-ea7ee984675b tempest-TestStampPattern-988815498 tempest-TestStampPattern-988815498-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1630980562" status: 202 len: 0 microversion: 2.1 time: 0.031956 Apr 24 00:18:06 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 101/311] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:18:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1630980562 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2116708494", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "destination_type": "volume"}], "networks": [{"uuid": "52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461"}]}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=5 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] validate_networks() for [('52d3b3b9-3aa8-4e9f-96ed-acbfc8a7b461', None, None, None, None, None)] {{(pid=61492) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image limits 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Flavor pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Image pref 0:0:0 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.virt.hardware [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Getting quotas for user 8d0ab07106dd4995aa7e3f5b6bc70e56 and project d26ba1ed4b9241f9a084db1a14a945bb. Resources: {'instances', 'cores', 'ram'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Going to run 1 instances... {{(pid=61492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:18:14 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:18:14 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-3eeae232-27ed-4300-b4c6-bd5b3f676e6e tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.601828 Apr 24 00:18:14 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 108/312] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 24 00:18:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-2620684c-edc1-49a7-a6b9-69e865b64cdb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-2620684c-edc1-49a7-a6b9-69e865b64cdb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2620684c-edc1-49a7-a6b9-69e865b64cdb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2620684c-edc1-49a7-a6b9-69e865b64cdb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:18:14 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2620684c-edc1-49a7-a6b9-69e865b64cdb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:18:14 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-2620684c-edc1-49a7-a6b9-69e865b64cdb tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b" status: 200 len: 1395 microversion: 2.87 time: 0.098453 Apr 24 00:18:14 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 104/313] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:18:14 2023] GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b => generated 1395 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:18:18 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:18 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-247767dd-42b2-4094-b0d6-efdc936eedc9 req-75a6f92f-5519-48f6-baac-e09899b8ac77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b", "tag": "7b810a2e-d494-43d7-8263-761798c03a31"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:18:18 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-247767dd-42b2-4094-b0d6-efdc936eedc9 req-75a6f92f-5519-48f6-baac-e09899b8ac77 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:18 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-247767dd-42b2-4094-b0d6-efdc936eedc9 req-75a6f92f-5519-48f6-baac-e09899b8ac77 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:18 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-247767dd-42b2-4094-b0d6-efdc936eedc9 req-75a6f92f-5519-48f6-baac-e09899b8ac77 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:18 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-247767dd-42b2-4094-b0d6-efdc936eedc9 req-75a6f92f-5519-48f6-baac-e09899b8ac77 service nova] Creating event network-changed:7b810a2e-d494-43d7-8263-761798c03a31 for instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b on user Apr 24 00:18:18 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-247767dd-42b2-4094-b0d6-efdc936eedc9 req-75a6f92f-5519-48f6-baac-e09899b8ac77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040352 Apr 24 00:18:18 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 102/314] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:18:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:18:20 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-bc7a7800-6f29-4bd8-9ec1-a6e96d9eac0e req-37590f95-3fe2-48e9-88e3-725277694091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b", "name": "network-vif-deleted", "tag": "7b810a2e-d494-43d7-8263-761798c03a31"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:18:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bc7a7800-6f29-4bd8-9ec1-a6e96d9eac0e req-37590f95-3fe2-48e9-88e3-725277694091 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bc7a7800-6f29-4bd8-9ec1-a6e96d9eac0e req-37590f95-3fe2-48e9-88e3-725277694091 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-bc7a7800-6f29-4bd8-9ec1-a6e96d9eac0e req-37590f95-3fe2-48e9-88e3-725277694091 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:20 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.compute.server_external_events [req-bc7a7800-6f29-4bd8-9ec1-a6e96d9eac0e req-37590f95-3fe2-48e9-88e3-725277694091 service nova] Unable to find a host for instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b. Dropping event network-vif-deleted {{(pid=61492) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 24 00:18:20 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-bc7a7800-6f29-4bd8-9ec1-a6e96d9eac0e req-37590f95-3fe2-48e9-88e3-725277694091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039640 Apr 24 00:18:20 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 109/315] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:18:20 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:20 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:21 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:18:21 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-224bbade-b8e8-41a5-9c80-812f234ff1ce tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 200 len: 1542 microversion: 2.1 time: 0.248269 Apr 24 00:18:21 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 105/316] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:18:20 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 1542 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:18:31 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:31 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:31 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-cad18430-607c-4f47-a984-450dd2c1bf02 tempest-TestVolumeBootPattern-1906728481 tempest-TestVolumeBootPattern-1906728481-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3767910>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-905115508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUO7+BexjksQT601R5ryyzIlBST0XeLUKwnb6XBZApDyo9pk/NwlQ6zWOH4KcqnAAdPwUNZ6qE8bTWmTsk6Z+ADq/J7un8S8v10JSUa9UHQ34bibBmTF5JCGUfPNpptBg=="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:18:31 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-cad18430-607c-4f47-a984-450dd2c1bf02 tempest-TestVolumeBootPattern-1906728481 tempest-TestVolumeBootPattern-1906728481-project-member] Getting quotas for project 49f46c801b224352b0b12f8653fdf122. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:18:31 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-cad18430-607c-4f47-a984-450dd2c1bf02 tempest-TestVolumeBootPattern-1906728481 tempest-TestVolumeBootPattern-1906728481-project-member] Getting quotas for user a2bc0a69976144909783464c14e2710e and project 49f46c801b224352b0b12f8653fdf122. Resources: {'key_pairs'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:18:31 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-cad18430-607c-4f47-a984-450dd2c1bf02 tempest-TestVolumeBootPattern-1906728481 tempest-TestVolumeBootPattern-1906728481-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.052042 Apr 24 00:18:31 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 103/317] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:18:31 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:18:34 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-a6b68580-03e9-4333-9e7f-8dbe224193fb tempest-TestVolumeBootPattern-1906728481 tempest-TestVolumeBootPattern-1906728481-project-member] Calling method '.version_select at 0x7fc8c3708700>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:34 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:34 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:34 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:34 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:34 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-a6b68580-03e9-4333-9e7f-8dbe224193fb tempest-TestVolumeBootPattern-1906728481 tempest-TestVolumeBootPattern-1906728481-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-905115508" status: 202 len: 0 microversion: 2.1 time: 0.030887 Apr 24 00:18:34 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 110/318] 10.0.0.210 () {62 vars in 1337 bytes} [Mon Apr 24 00:18:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-905115508 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=8 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:35 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4192d379850d40c5b684d8835548acd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9011aa88afdb40f4be4c2e9846fa72dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:18:36 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-20b89a59-c04b-48dd-9165-e0cea1d25e4b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9" status: 200 len: 1569 microversion: 2.1 time: 0.264248 Apr 24 00:18:36 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:18:35 2023] GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] [instance: ac38bbc2-2229-4497-b501-e9230ec59a32] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:37 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] HTTP exception thrown: Instance ac38bbc2-2229-4497-b501-e9230ec59a32 could not be found. Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Request method failure captured: Apr 24 00:18:37 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32 HTTP/1.1 Apr 24 00:18:37 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:18:37 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:18:37 user devstack@n-api.service[61491]: Connection: close Apr 24 00:18:37 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:18:37 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:18:37 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:18:37 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:18:37 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRclYqXT7PnV_uWVZ5U2zU-dcQF-R3UDRQk_-qBfs4_T8qLs5P3_mxfy9nxywsKezgZp4JqYsLyUUFaz6LKyz31ZbmZdwlqVEwJ3F25fNbKYGV1h41xGCA-Jspa-zm4OH-cL-k2LK7GcmlnfPBNHvoORXEFyFBwmWLn7Rr18qpCyB8Ak Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Project-Id: 5cff0cbf3a5c4a4aadb3399a31adff0d Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487575741 Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cff0cbf3a5c4a4aadb3399a31adff0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5cff0cbf3a5c4a4aadb3399a31adff0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5cff0cbf3a5c4a4aadb3399a31adff0d"}]}] Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487575741 Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Tenant-Id: 5cff0cbf3a5c4a4aadb3399a31adff0d Apr 24 00:18:37 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487575741 Apr 24 00:18:37 user devstack@n-api.service[61491]: X-User: tempest-ServerRescueNegativeTestJSON-487575741-project-member Apr 24 00:18:37 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:18:37 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:18:37 user devstack@n-api.service[61491]: X-User-Id: 514ecffec8034d60ae3c00ecd1ef5c8b Apr 24 00:18:37 user devstack@n-api.service[61491]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487575741-project-member Apr 24 00:18:37 user devstack@n-api.service[61491]: method: > Apr 24 00:18:37 user devstack@n-api.service[61491]: exception: Instance ac38bbc2-2229-4497-b501-e9230ec59a32 could not be found. Apr 24 00:18:37 user devstack@n-api.service[61491]: action_args: {'id': 'ac38bbc2-2229-4497-b501-e9230ec59a32'} Apr 24 00:18:37 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac38bbc2-2229-4497-b501-e9230ec59a32 could not be found. Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac38bbc2-2229-4497-b501-e9230ec59a32 could not be found. Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac38bbc2-2229-4497-b501-e9230ec59a32 could not be found. Apr 24 00:18:37 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:18:37 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] Returning 404 to user: Instance ac38bbc2-2229-4497-b501-e9230ec59a32 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:18:37 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-f18062da-1412-4db6-b924-a4fc693bb268 tempest-ServerRescueNegativeTestJSON-487575741 tempest-ServerRescueNegativeTestJSON-487575741-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32" status: 404 len: 111 microversion: 2.1 time: 0.028529 Apr 24 00:18:37 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 104/320] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:18:37 2023] GET /compute/v2.1/servers/ac38bbc2-2229-4497-b501-e9230ec59a32 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:39 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:18:39 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-29d0065a-d958-4f33-aca3-91bb14f3de1e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.375643 Apr 24 00:18:39 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 111/321] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:18:39 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:18:59 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:00 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:00 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-e7df9f13-7c98-45bd-b661-5386f0824439 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1494 microversion: 2.1 time: 0.244161 Apr 24 00:19:00 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:18:59 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1494 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:04 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:04 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:04 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.objects.instance [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lazy-loading 'fault' on Instance uuid 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b {{(pid=61491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:05 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-58f56696-cb14-4ae6-850f-a5a89a26b039 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b" status: 200 len: 1650 microversion: 2.87 time: 0.177652 Apr 24 00:19:05 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 105/323] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:19:04 2023] GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b => generated 1650 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Doing local delete in cell a345e55a-e119-441a-a250-b58384b04676(cell1) {{(pid=61492) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61492]: WARNING nova.compute.api [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] instance's host None is down, deleting from database Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] deallocate_for_instance() {{(pid=61492) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Instance cache missing network info. {{(pid=61492) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.network.neutron [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Updating instance_info_cache with network_info: [] {{(pid=61492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 24 00:19:05 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61492) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 24 00:19:05 user devstack@n-api.service[61492]: WARNING nova.compute.api [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 24 00:19:05 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-ff27c296-3777-483e-987e-c55fa62c74b8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b" status: 204 len: 0 microversion: 2.87 time: 0.553149 Apr 24 00:19:05 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 112/324] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:19:05 2023] DELETE /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] HTTP exception thrown: Instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b could not be found. Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Request method failure captured: Apr 24 00:19:05 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b HTTP/1.1 Apr 24 00:19:05 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:19:05 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:19:05 user devstack@n-api.service[61493]: Connection: close Apr 24 00:19:05 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:19:05 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:19:05 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:19:05 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:19:05 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcks9jIUpJseB24-8cTq-FqbEDKIROUOEAF7JNU4Rnmey_q6uim9Me6xO25MvzT8gYSzs3B2QVrDC7uDGPpqmM1MBIiIHDJlC-Sbvh-FAY65lwcd_YYbyiLvEk6be4GT0CxJl1HJBeyWhjfIDMUzSd--u056bsfyKH5X-FZOyqRQm6g Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Openstack-Nova-Api-Version: 2.87 Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Project-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d26ba1ed4b9241f9a084db1a14a945bb"}]}] Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Tenant-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:19:05 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:19:05 user devstack@n-api.service[61493]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:19:05 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:19:05 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:19:05 user devstack@n-api.service[61493]: X-User-Id: 8d0ab07106dd4995aa7e3f5b6bc70e56 Apr 24 00:19:05 user devstack@n-api.service[61493]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:19:05 user devstack@n-api.service[61493]: method: > Apr 24 00:19:05 user devstack@n-api.service[61493]: exception: Instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b could not be found. Apr 24 00:19:05 user devstack@n-api.service[61493]: action_args: {'id': '7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b'} Apr 24 00:19:05 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b could not be found. Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b could not be found. Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b could not be found. Apr 24 00:19:05 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:19:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Returning 404 to user: Instance 7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:19:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-ad763af8-e122-4721-b99f-72b032be6734 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b" status: 404 len: 111 microversion: 2.87 time: 0.030074 Apr 24 00:19:05 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 108/325] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:19:05 2023] GET /compute/v2.1/servers/7eadcb12-3a4f-49c1-9bcc-8c2f94052e6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:05 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Going to try to terminate instance {{(pid=61491) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:19:06 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-2d359527-009f-4d8c-82c1-3cac5a19c6d6 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d" status: 204 len: 0 microversion: 2.87 time: 0.124178 Apr 24 00:19:06 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 106/326] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:19:05 2023] DELETE /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:06 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:06 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-67e1806c-f620-4af1-a5dd-9bf890fa3282 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d" status: 200 len: 1695 microversion: 2.87 time: 0.365906 Apr 24 00:19:06 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 113/327] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:19:06 2023] GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d => generated 1695 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:19:06 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-e238b01d-96df-4cf8-a8fb-5ef2922874fa req-995f92d2-5d0d-45ba-af2d-cd670de9ac6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91af3a-b837-4ff0-a236-3483ffe5277d", "name": "network-vif-unplugged", "status": "completed", "tag": "7cef5b8b-d733-4f6a-8567-4b9e7e650fbb"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-e238b01d-96df-4cf8-a8fb-5ef2922874fa req-995f92d2-5d0d-45ba-af2d-cd670de9ac6a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-e238b01d-96df-4cf8-a8fb-5ef2922874fa req-995f92d2-5d0d-45ba-af2d-cd670de9ac6a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:06 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-e238b01d-96df-4cf8-a8fb-5ef2922874fa req-995f92d2-5d0d-45ba-af2d-cd670de9ac6a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:06 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-e238b01d-96df-4cf8-a8fb-5ef2922874fa req-995f92d2-5d0d-45ba-af2d-cd670de9ac6a service nova] Creating event network-vif-unplugged:7cef5b8b-d733-4f6a-8567-4b9e7e650fbb for instance 1c91af3a-b837-4ff0-a236-3483ffe5277d on user Apr 24 00:19:06 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-e238b01d-96df-4cf8-a8fb-5ef2922874fa req-995f92d2-5d0d-45ba-af2d-cd670de9ac6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030539 Apr 24 00:19:06 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 109/328] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:07 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-8bbc8dcc-d280-4205-be56-b66cfd223663 req-cb46a5b3-4edb-499b-ae81-49a9eca0638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91af3a-b837-4ff0-a236-3483ffe5277d", "name": "network-vif-deleted", "tag": "7cef5b8b-d733-4f6a-8567-4b9e7e650fbb"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-8bbc8dcc-d280-4205-be56-b66cfd223663 req-cb46a5b3-4edb-499b-ae81-49a9eca0638a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-8bbc8dcc-d280-4205-be56-b66cfd223663 req-cb46a5b3-4edb-499b-ae81-49a9eca0638a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:07 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-8bbc8dcc-d280-4205-be56-b66cfd223663 req-cb46a5b3-4edb-499b-ae81-49a9eca0638a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-8bbc8dcc-d280-4205-be56-b66cfd223663 req-cb46a5b3-4edb-499b-ae81-49a9eca0638a service nova] Creating event network-vif-deleted:7cef5b8b-d733-4f6a-8567-4b9e7e650fbb for instance 1c91af3a-b837-4ff0-a236-3483ffe5277d on user Apr 24 00:19:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-8bbc8dcc-d280-4205-be56-b66cfd223663 req-cb46a5b3-4edb-499b-ae81-49a9eca0638a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037052 Apr 24 00:19:07 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 107/329] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-32b6edc5-b74c-494b-b061-565f13290b84 req-8c571e19-03b7-43f1-87f3-ec3026398718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91af3a-b837-4ff0-a236-3483ffe5277d", "name": "network-vif-plugged", "status": "completed", "tag": "7cef5b8b-d733-4f6a-8567-4b9e7e650fbb"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-32b6edc5-b74c-494b-b061-565f13290b84 req-8c571e19-03b7-43f1-87f3-ec3026398718 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-32b6edc5-b74c-494b-b061-565f13290b84 req-8c571e19-03b7-43f1-87f3-ec3026398718 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-32b6edc5-b74c-494b-b061-565f13290b84 req-8c571e19-03b7-43f1-87f3-ec3026398718 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-32b6edc5-b74c-494b-b061-565f13290b84 req-8c571e19-03b7-43f1-87f3-ec3026398718 service nova] Creating event network-vif-plugged:7cef5b8b-d733-4f6a-8567-4b9e7e650fbb for instance 1c91af3a-b837-4ff0-a236-3483ffe5277d on user Apr 24 00:19:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-32b6edc5-b74c-494b-b061-565f13290b84 req-8c571e19-03b7-43f1-87f3-ec3026398718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Apr 24 00:19:08 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 114/330] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:16 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:16 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=10 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:17 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c7d7d25e-ec48-49b9-9f8b-eee18fdb487b tempest-TestShelveInstance-207420699 tempest-TestShelveInstance-207420699-project-member] Action: 'create', calling method: .version_select at 0x7fc8c38aed40>, body: {"keypair": {"name": "tempest-TestShelveInstance-1434275508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ3T1CY8LTI3O6RfGvY+DCt7UhmYFULrLsiOh+j2nMiTCybOOZDSmj18JlDsMoH2oawcRF9AmWryLqO4wISMKnOqWmzN/0XsjiKsjTDBOeZBcfc/4e+SGH6RvKtBeS3rw=="}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:17 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-c7d7d25e-ec48-49b9-9f8b-eee18fdb487b tempest-TestShelveInstance-207420699 tempest-TestShelveInstance-207420699-project-member] Getting quotas for project 12a9cc7687fc4ee290cca02f93e23bdc. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:19:17 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-c7d7d25e-ec48-49b9-9f8b-eee18fdb487b tempest-TestShelveInstance-207420699 tempest-TestShelveInstance-207420699-project-member] Getting quotas for user 2c50335139924d0580da429a4c5242a0 and project 12a9cc7687fc4ee290cca02f93e23bdc. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:19:17 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-c7d7d25e-ec48-49b9-9f8b-eee18fdb487b tempest-TestShelveInstance-207420699 tempest-TestShelveInstance-207420699-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308055 Apr 24 00:19:17 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 110/331] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:19:16 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:20 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c11de0fd-a10f-408a-8193-7b0e6bfefb39 tempest-TestShelveInstance-207420699 tempest-TestShelveInstance-207420699-project-member] Calling method '.version_select at 0x7fc8c3766950>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:20 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:20 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:20 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-c11de0fd-a10f-408a-8193-7b0e6bfefb39 tempest-TestShelveInstance-207420699 tempest-TestShelveInstance-207420699-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1434275508" status: 202 len: 0 microversion: 2.1 time: 0.029169 Apr 24 00:19:20 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 108/332] 10.0.0.210 () {62 vars in 1331 bytes} [Mon Apr 24 00:19:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1434275508 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:21 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:21 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-efbae19f-89d9-455a-80e6-437a5145ad31 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.210833 Apr 24 00:19:21 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 115/333] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:19:21 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3/os-interface => generated 282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:22 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-e515dc65-dbe0-4850-8e84-06d6fd1b9857 req-83791e50-75f9-4a97-9cb8-60b27d182757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-e515dc65-dbe0-4850-8e84-06d6fd1b9857 req-83791e50-75f9-4a97-9cb8-60b27d182757 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-e515dc65-dbe0-4850-8e84-06d6fd1b9857 req-83791e50-75f9-4a97-9cb8-60b27d182757 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:22 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-e515dc65-dbe0-4850-8e84-06d6fd1b9857 req-83791e50-75f9-4a97-9cb8-60b27d182757 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:22 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-e515dc65-dbe0-4850-8e84-06d6fd1b9857 req-83791e50-75f9-4a97-9cb8-60b27d182757 service nova] Creating event network-changed:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:19:22 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-e515dc65-dbe0-4850-8e84-06d6fd1b9857 req-83791e50-75f9-4a97-9cb8-60b27d182757 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029153 Apr 24 00:19:22 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 111/334] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:22 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-10d5d003-a600-4ca2-b4fe-a7e8f57edccb tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3/ips" status: 200 len: 107 microversion: 2.1 time: 0.034577 Apr 24 00:19:22 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 109/335] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:19:22 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3/ips => generated 107 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:23 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:19:23 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-10085def-6121-437f-950d-964299f7a5f7 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 204 len: 0 microversion: 2.1 time: 0.104791 Apr 24 00:19:23 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 116/336] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:19:23 2023] DELETE /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:23 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:24 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-ee3ff0f1-6dc0-4b1e-8122-caebda62442f req-710b01b1-85c0-4a12-977c-4581de5fc5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "name": "network-vif-unplugged", "status": "completed", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ee3ff0f1-6dc0-4b1e-8122-caebda62442f req-710b01b1-85c0-4a12-977c-4581de5fc5a7 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ee3ff0f1-6dc0-4b1e-8122-caebda62442f req-710b01b1-85c0-4a12-977c-4581de5fc5a7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:24 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ee3ff0f1-6dc0-4b1e-8122-caebda62442f req-710b01b1-85c0-4a12-977c-4581de5fc5a7 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:24 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-ee3ff0f1-6dc0-4b1e-8122-caebda62442f req-710b01b1-85c0-4a12-977c-4581de5fc5a7 service nova] Creating event network-vif-unplugged:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:19:24 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-ee3ff0f1-6dc0-4b1e-8122-caebda62442f req-710b01b1-85c0-4a12-977c-4581de5fc5a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031257 Apr 24 00:19:24 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 110/337] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 24 00:19:24 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:24 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-57449bfb-3d1b-44b6-ae1e-284de85358b3 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 200 len: 1667 microversion: 2.1 time: 0.315372 Apr 24 00:19:24 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:19:23 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 1667 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:25 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-e11a3711-0f5b-4427-864c-7b925133ad09 req-843b97ad-5e7e-445f-a56c-0e960fdff7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "name": "network-vif-deleted", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:25 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e11a3711-0f5b-4427-864c-7b925133ad09 req-843b97ad-5e7e-445f-a56c-0e960fdff7a2 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:25 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e11a3711-0f5b-4427-864c-7b925133ad09 req-843b97ad-5e7e-445f-a56c-0e960fdff7a2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:25 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e11a3711-0f5b-4427-864c-7b925133ad09 req-843b97ad-5e7e-445f-a56c-0e960fdff7a2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:25 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-e11a3711-0f5b-4427-864c-7b925133ad09 req-843b97ad-5e7e-445f-a56c-0e960fdff7a2 service nova] Creating event network-vif-deleted:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:19:25 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-e11a3711-0f5b-4427-864c-7b925133ad09 req-843b97ad-5e7e-445f-a56c-0e960fdff7a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090649 Apr 24 00:19:25 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 117/339] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:26 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-bba0c61e-e115-4f55-a78b-abc368b9d003 req-dea2d2b2-304b-4858-82de-f76e86f07a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e58fac-ff2d-47e5-866d-de1f2b741cb3", "name": "network-vif-plugged", "status": "completed", "tag": "bbf311b8-ca79-433b-9979-dd2ee6102146"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bba0c61e-e115-4f55-a78b-abc368b9d003 req-dea2d2b2-304b-4858-82de-f76e86f07a62 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bba0c61e-e115-4f55-a78b-abc368b9d003 req-dea2d2b2-304b-4858-82de-f76e86f07a62 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:26 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-bba0c61e-e115-4f55-a78b-abc368b9d003 req-dea2d2b2-304b-4858-82de-f76e86f07a62 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:26 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-bba0c61e-e115-4f55-a78b-abc368b9d003 req-dea2d2b2-304b-4858-82de-f76e86f07a62 service nova] Creating event network-vif-plugged:bbf311b8-ca79-433b-9979-dd2ee6102146 for instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 on user Apr 24 00:19:26 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-bba0c61e-e115-4f55-a78b-abc368b9d003 req-dea2d2b2-304b-4858-82de-f76e86f07a62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030381 Apr 24 00:19:26 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 111/340] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=8 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:36 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4192d379850d40c5b684d8835548acd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9011aa88afdb40f4be4c2e9846fa72dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:36 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-1350696d-2435-401d-9feb-03caeb35844b tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9" status: 200 len: 1569 microversion: 2.1 time: 0.235138 Apr 24 00:19:36 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:19:36 2023] GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:37 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:19:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-4d8dddce-5407-4b8b-8af4-1ad04432d6ee tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9" status: 204 len: 0 microversion: 2.1 time: 0.119767 Apr 24 00:19:38 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 118/342] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:19:37 2023] DELETE /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=8 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:38 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-780e408e-9f7c-490a-b5d3-ec6715a59822 req-b392cb0b-935b-41a9-a82a-fcdeb11cf231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1728a086-3a73-4157-8c2f-3606820448a9", "name": "network-vif-unplugged", "status": "completed", "tag": "1d88c88b-4db7-4078-b68a-941a4a4e7920"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-780e408e-9f7c-490a-b5d3-ec6715a59822 req-b392cb0b-935b-41a9-a82a-fcdeb11cf231 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-780e408e-9f7c-490a-b5d3-ec6715a59822 req-b392cb0b-935b-41a9-a82a-fcdeb11cf231 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-780e408e-9f7c-490a-b5d3-ec6715a59822 req-b392cb0b-935b-41a9-a82a-fcdeb11cf231 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:38 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-780e408e-9f7c-490a-b5d3-ec6715a59822 req-b392cb0b-935b-41a9-a82a-fcdeb11cf231 service nova] Creating event network-vif-unplugged:1d88c88b-4db7-4078-b68a-941a4a4e7920 for instance 1728a086-3a73-4157-8c2f-3606820448a9 on user Apr 24 00:19:38 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-780e408e-9f7c-490a-b5d3-ec6715a59822 req-b392cb0b-935b-41a9-a82a-fcdeb11cf231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028614 Apr 24 00:19:38 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 114/343] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:38 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4192d379850d40c5b684d8835548acd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9011aa88afdb40f4be4c2e9846fa72dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:38 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-a6141a25-50ba-4e2f-bc4c-77e833000204 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9" status: 200 len: 1575 microversion: 2.1 time: 0.261986 Apr 24 00:19:38 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 112/344] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:19:38 2023] GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:40 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-d24a0428-e319-4b01-8413-0fb97b345926 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.225739 Apr 24 00:19:40 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 119/345] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:19:40 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1728a086-3a73-4157-8c2f-3606820448a9", "name": "network-vif-plugged", "status": "completed", "tag": "1d88c88b-4db7-4078-b68a-941a4a4e7920"}, {"server_uuid": "1728a086-3a73-4157-8c2f-3606820448a9", "name": "network-vif-deleted", "tag": "1d88c88b-4db7-4078-b68a-941a4a4e7920"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] Creating event network-vif-plugged:1d88c88b-4db7-4078-b68a-941a4a4e7920 for instance 1728a086-3a73-4157-8c2f-3606820448a9 on user Apr 24 00:19:40 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] Creating event network-vif-deleted:1d88c88b-4db7-4078-b68a-941a4a4e7920 for instance 1728a086-3a73-4157-8c2f-3606820448a9 on user Apr 24 00:19:40 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-98612458-8a25-4cec-8a6e-b04ff3730ffb req-c769f142-e68c-404d-8c62-c64cc4142422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033765 Apr 24 00:19:40 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 113/346] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:40 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:40 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-7ce633b9-79b4-479b-a121-a486918b681e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.157221 Apr 24 00:19:40 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:19:40 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:40 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:40 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-cfa2d9f1-b547-420b-b7a3-3e3234b034f5 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.162099 Apr 24 00:19:40 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 120/348] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:19:40 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=8 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: 1c91af3a-b837-4ff0-a236-3483ffe5277d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] HTTP exception thrown: Instance 1c91af3a-b837-4ff0-a236-3483ffe5277d could not be found. Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Request method failure captured: Apr 24 00:19:56 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d HTTP/1.1 Apr 24 00:19:56 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:19:56 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:19:56 user devstack@n-api.service[61491]: Connection: close Apr 24 00:19:56 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:19:56 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:19:56 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:19:56 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:19:56 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcks9jIUpJseB24-8cTq-FqbEDKIROUOEAF7JNU4Rnmey_q6uim9Me6xO25MvzT8gYSzs3B2QVrDC7uDGPpqmM1MBIiIHDJlC-Sbvh-FAY65lwcd_YYbyiLvEk6be4GT0CxJl1HJBeyWhjfIDMUzSd--u056bsfyKH5X-FZOyqRQm6g Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Openstack-Nova-Api-Version: 2.87 Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Project-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d26ba1ed4b9241f9a084db1a14a945bb"}]}] Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Tenant-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:19:56 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:19:56 user devstack@n-api.service[61491]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:19:56 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:19:56 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:19:56 user devstack@n-api.service[61491]: X-User-Id: 8d0ab07106dd4995aa7e3f5b6bc70e56 Apr 24 00:19:56 user devstack@n-api.service[61491]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:19:56 user devstack@n-api.service[61491]: method: > Apr 24 00:19:56 user devstack@n-api.service[61491]: exception: Instance 1c91af3a-b837-4ff0-a236-3483ffe5277d could not be found. Apr 24 00:19:56 user devstack@n-api.service[61491]: action_args: {'id': '1c91af3a-b837-4ff0-a236-3483ffe5277d'} Apr 24 00:19:56 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c91af3a-b837-4ff0-a236-3483ffe5277d could not be found. Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c91af3a-b837-4ff0-a236-3483ffe5277d could not be found. Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c91af3a-b837-4ff0-a236-3483ffe5277d could not be found. Apr 24 00:19:56 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:19:56 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Returning 404 to user: Instance 1c91af3a-b837-4ff0-a236-3483ffe5277d could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:19:56 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-0f010a5a-9ebe-4e7b-8e7e-393d859ab630 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d" status: 404 len: 111 microversion: 2.87 time: 0.031722 Apr 24 00:19:56 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 114/349] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:19:56 2023] GET /compute/v2.1/servers/1c91af3a-b837-4ff0-a236-3483ffe5277d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=14 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:56 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:19:56 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-01d834ca-3430-4702-8d16-6b507cf25145 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b" status: 204 len: 0 microversion: 2.87 time: 0.118590 Apr 24 00:19:56 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 116/350] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 24 00:19:56 2023] DELETE /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:57 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:57 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:57 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d0ab07106dd4995aa7e3f5b6bc70e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba1ed4b9241f9a084db1a14a945bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:19:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-828cc810-9e6f-405d-b423-b1f0fdfaa9f8 tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b" status: 200 len: 1696 microversion: 2.87 time: 0.313079 Apr 24 00:19:57 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 121/351] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:19:56 2023] GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b => generated 1696 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 24 00:19:57 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-ca663ec4-35f4-44b1-8e64-22146b07ef71 req-587236a1-6d93-4373-bd20-9aa1ea7d8e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b", "name": "network-vif-unplugged", "status": "completed", "tag": "7a3b1d96-2c84-4994-b698-c59fb56c44f8"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ca663ec4-35f4-44b1-8e64-22146b07ef71 req-587236a1-6d93-4373-bd20-9aa1ea7d8e1b service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ca663ec4-35f4-44b1-8e64-22146b07ef71 req-587236a1-6d93-4373-bd20-9aa1ea7d8e1b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:57 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-ca663ec4-35f4-44b1-8e64-22146b07ef71 req-587236a1-6d93-4373-bd20-9aa1ea7d8e1b service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-ca663ec4-35f4-44b1-8e64-22146b07ef71 req-587236a1-6d93-4373-bd20-9aa1ea7d8e1b service nova] Creating event network-vif-unplugged:7a3b1d96-2c84-4994-b698-c59fb56c44f8 for instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b on user Apr 24 00:19:57 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-ca663ec4-35f4-44b1-8e64-22146b07ef71 req-587236a1-6d93-4373-bd20-9aa1ea7d8e1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036423 Apr 24 00:19:57 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 115/352] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:57 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-fa11a416-bf85-4269-88dd-9d75765131fe req-43607460-7b1d-452b-942a-ba11f6111330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b", "name": "network-vif-deleted", "tag": "7a3b1d96-2c84-4994-b698-c59fb56c44f8"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-fa11a416-bf85-4269-88dd-9d75765131fe req-43607460-7b1d-452b-942a-ba11f6111330 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-fa11a416-bf85-4269-88dd-9d75765131fe req-43607460-7b1d-452b-942a-ba11f6111330 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:57 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-fa11a416-bf85-4269-88dd-9d75765131fe req-43607460-7b1d-452b-942a-ba11f6111330 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:57 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-fa11a416-bf85-4269-88dd-9d75765131fe req-43607460-7b1d-452b-942a-ba11f6111330 service nova] Creating event network-vif-deleted:7a3b1d96-2c84-4994-b698-c59fb56c44f8 for instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b on user Apr 24 00:19:57 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-fa11a416-bf85-4269-88dd-9d75765131fe req-43607460-7b1d-452b-942a-ba11f6111330 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 Apr 24 00:19:57 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:19:59 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-b8b04144-8e63-4db3-baa9-83bda2dbfd56 req-1424ec26-ba7f-4c4a-9b70-6ed0007d02a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b", "name": "network-vif-plugged", "status": "completed", "tag": "7a3b1d96-2c84-4994-b698-c59fb56c44f8"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:19:59 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-b8b04144-8e63-4db3-baa9-83bda2dbfd56 req-1424ec26-ba7f-4c4a-9b70-6ed0007d02a1 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:19:59 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-b8b04144-8e63-4db3-baa9-83bda2dbfd56 req-1424ec26-ba7f-4c4a-9b70-6ed0007d02a1 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:19:59 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-b8b04144-8e63-4db3-baa9-83bda2dbfd56 req-1424ec26-ba7f-4c4a-9b70-6ed0007d02a1 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:19:59 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-b8b04144-8e63-4db3-baa9-83bda2dbfd56 req-1424ec26-ba7f-4c4a-9b70-6ed0007d02a1 service nova] Creating event network-vif-plugged:7a3b1d96-2c84-4994-b698-c59fb56c44f8 for instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b on user Apr 24 00:19:59 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-b8b04144-8e63-4db3-baa9-83bda2dbfd56 req-1424ec26-ba7f-4c4a-9b70-6ed0007d02a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Apr 24 00:19:59 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 122/354] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:19:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] HTTP exception thrown: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Request method failure captured: Apr 24 00:20:00 user devstack@n-api.service[61491]: request: DELETE /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d HTTP/1.1 Apr 24 00:20:00 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:20:00 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:20:00 user devstack@n-api.service[61491]: Connection: close Apr 24 00:20:00 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:20:00 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:20:00 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:20:00 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:20:00 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcknbEbJiLaFKm-Vp8fpFWaMYaeIMVlEum0rC_gcob1n4C2qD4-3OOTg19oE0ATJIKi-8M210PiwwRlLExga5iD7yuFvGLgT6t3N4tVMG-LbvilQDesbm_9IWJCRWoEzFQ2ZybiFE2hp3YXndKdLHaoMgduJRyPUK24AUWMYCvD2ZFI Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Project-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Project-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce75f63fc0904eceb03e8319bddba4d3"}]}] Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Tenant: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Tenant-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:20:00 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:00 user devstack@n-api.service[61491]: X-User: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:20:00 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:20:00 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:20:00 user devstack@n-api.service[61491]: X-User-Id: abae98323deb44dea0622186485cc7af Apr 24 00:20:00 user devstack@n-api.service[61491]: X-User-Name: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:20:00 user devstack@n-api.service[61491]: method: > Apr 24 00:20:00 user devstack@n-api.service[61491]: exception: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61491]: action_args: {'id': '1821ecf2-8c71-48ad-96da-f63b83439c6d'} Apr 24 00:20:00 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Returning 404 to user: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:20:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-ed82bb8e-6c1e-43b4-904c-8429bdf8607a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 404 len: 111 microversion: 2.1 time: 0.045460 Apr 24 00:20:00 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 116/355] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:20:00 2023] DELETE /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: 1821ecf2-8c71-48ad-96da-f63b83439c6d] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] HTTP exception thrown: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Request method failure captured: Apr 24 00:20:00 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d HTTP/1.1 Apr 24 00:20:00 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:20:00 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:20:00 user devstack@n-api.service[61493]: Connection: close Apr 24 00:20:00 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:20:00 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:20:00 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:20:00 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:20:00 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcknbEbJiLaFKm-Vp8fpFWaMYaeIMVlEum0rC_gcob1n4C2qD4-3OOTg19oE0ATJIKi-8M210PiwwRlLExga5iD7yuFvGLgT6t3N4tVMG-LbvilQDesbm_9IWJCRWoEzFQ2ZybiFE2hp3YXndKdLHaoMgduJRyPUK24AUWMYCvD2ZFI Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Project-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Project-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce75f63fc0904eceb03e8319bddba4d3"}]}] Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Tenant: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Tenant-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:20:00 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:00 user devstack@n-api.service[61493]: X-User: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:20:00 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:20:00 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:20:00 user devstack@n-api.service[61493]: X-User-Id: abae98323deb44dea0622186485cc7af Apr 24 00:20:00 user devstack@n-api.service[61493]: X-User-Name: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:20:00 user devstack@n-api.service[61493]: method: > Apr 24 00:20:00 user devstack@n-api.service[61493]: exception: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61493]: action_args: {'id': '1821ecf2-8c71-48ad-96da-f63b83439c6d'} Apr 24 00:20:00 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. Apr 24 00:20:00 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Returning 404 to user: Instance 1821ecf2-8c71-48ad-96da-f63b83439c6d could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:20:00 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-0a262a78-65ce-47ab-b9a7-05e68c30164b tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d" status: 404 len: 111 microversion: 2.1 time: 0.026802 Apr 24 00:20:00 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 118/356] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:00 2023] GET /compute/v2.1/servers/1821ecf2-8c71-48ad-96da-f63b83439c6d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:20:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-a002df15-d73b-474f-9d1b-46300ecc957a tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 204 len: 0 microversion: 2.1 time: 0.110921 Apr 24 00:20:00 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 123/357] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:20:00 2023] DELETE /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-1f80b470-982c-4bf0-9f21-14381c1aa53c req-b8ecb232-aebf-473e-883d-dc3d0c2fd159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce19423d-a6ee-4506-9cd1-ec4803abdd86", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c98734-17ee-42d0-9372-fd76526b0b27"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-1f80b470-982c-4bf0-9f21-14381c1aa53c req-b8ecb232-aebf-473e-883d-dc3d0c2fd159 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-1f80b470-982c-4bf0-9f21-14381c1aa53c req-b8ecb232-aebf-473e-883d-dc3d0c2fd159 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:00 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abae98323deb44dea0622186485cc7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce75f63fc0904eceb03e8319bddba4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:20:00 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-1f80b470-982c-4bf0-9f21-14381c1aa53c req-b8ecb232-aebf-473e-883d-dc3d0c2fd159 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-bdf301cc-148b-435c-b97c-edd05e9461e7 tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 200 len: 1500 microversion: 2.1 time: 0.257692 Apr 24 00:20:00 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 117/358] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:00 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 1500 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:20:00 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-1f80b470-982c-4bf0-9f21-14381c1aa53c req-b8ecb232-aebf-473e-883d-dc3d0c2fd159 service nova] Creating event network-vif-unplugged:f6c98734-17ee-42d0-9372-fd76526b0b27 for instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 on user Apr 24 00:20:00 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-1f80b470-982c-4bf0-9f21-14381c1aa53c req-b8ecb232-aebf-473e-883d-dc3d0c2fd159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053987 Apr 24 00:20:00 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 119/359] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:20:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce19423d-a6ee-4506-9cd1-ec4803abdd86", "name": "network-vif-plugged", "status": "completed", "tag": "f6c98734-17ee-42d0-9372-fd76526b0b27"}, {"server_uuid": "ce19423d-a6ee-4506-9cd1-ec4803abdd86", "name": "network-vif-deleted", "tag": "f6c98734-17ee-42d0-9372-fd76526b0b27"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] Creating event network-vif-plugged:f6c98734-17ee-42d0-9372-fd76526b0b27 for instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 on user Apr 24 00:20:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] Creating event network-vif-deleted:f6c98734-17ee-42d0-9372-fd76526b0b27 for instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 on user Apr 24 00:20:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-695fec98-a39d-41d3-a9ae-6bb921938f28 req-8e7ce0bc-9deb-4ca7-be05-db92dd656b2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035831 Apr 24 00:20:02 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 124/360] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=8 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=12 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:20:14 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 HTTP/1.1 Apr 24 00:20:14 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:20:14 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:20:14 user devstack@n-api.service[61491]: Connection: close Apr 24 00:20:14 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:20:14 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:20:14 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:20:14 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:20:14 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:20:14 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:20:14 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:20:14 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:20:14 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:20:14 user devstack@n-api.service[61491]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:20:14 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:20:14 user devstack@n-api.service[61491]: method: > Apr 24 00:20:14 user devstack@n-api.service[61491]: exception: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:20:14 user devstack@n-api.service[61491]: action_args: {'id': 'a2e58fac-ff2d-47e5-866d-de1f2b741cb3'} Apr 24 00:20:14 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:20:14 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:14 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:20:14 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-9a4edd4c-262f-4c46-a6ac-ce3803e2092f tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 404 len: 111 microversion: 2.1 time: 0.237742 Apr 24 00:20:14 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 118/361] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:14 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:20:14 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:14 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:14 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-bf3adc63-25d6-4a9e-86a4-e2831f018176 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '.version_select at 0x7fc8c38ae200>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:14 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-bf3adc63-25d6-4a9e-86a4-e2831f018176 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669922603" status: 202 len: 0 microversion: 2.1 time: 0.029853 Apr 24 00:20:14 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 120/362] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 24 00:20:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669922603 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 24 00:20:15 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:15 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:15 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8deee1b7-54f9-43e1-8848-b85784cc5828 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3629c60>, body: {"keypair": {"name": "tempest-keypair-1028661157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS7J2r3hvdb0rW9oq624HJm6iEzqAHNFXYccC2ziX4/UQM6xe9IVnyYzcYeVB3AHvem3MrTEL+AAJWg7X9ws6qIEWDFHnxd+tlDDo0bvhx6gq7aYfsNiTDpRmFhx0Gb2g=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:15 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-8deee1b7-54f9-43e1-8848-b85784cc5828 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:20:15 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-8deee1b7-54f9-43e1-8848-b85784cc5828 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for user 35edcadbe77c4f4fa8304216e7f61d4a and project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:20:15 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8deee1b7-54f9-43e1-8848-b85784cc5828 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059785 Apr 24 00:20:15 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 125/363] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:20:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:16 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-806357688", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1a83eb44-caaf-46ff-8823-be4580052b3f"}], "security_groups": [{"name": "tempest-securitygroup--1603271245"}], "key_name": "tempest-keypair-1028661157", "user_data": "}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] validate_networks() for [('1a83eb44-caaf-46ff-8823-be4580052b3f', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Getting quotas for user 35edcadbe77c4f4fa8304216e7f61d4a and project 97d1e8a757a746329ea363af81a3c6b4. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:20:17 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:20:17 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-26f968e3-a8c4-4263-a69a-b0dc8297dc69 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.621847 Apr 24 00:20:17 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 119/364] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:20:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:20:17 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-717e04be-8762-44e3-9b8f-e23dbf441f95 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:17 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-717e04be-8762-44e3-9b8f-e23dbf441f95 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:17 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-717e04be-8762-44e3-9b8f-e23dbf441f95 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:20:17 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-717e04be-8762-44e3-9b8f-e23dbf441f95 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 200 len: 1235 microversion: 2.1 time: 0.075036 Apr 24 00:20:17 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 121/365] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:17 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:20:19 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-f32f244e-c11b-4462-b004-f3965f86ad0a req-2b5f78ad-181a-4999-a54d-55ed02506d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f32f244e-c11b-4462-b004-f3965f86ad0a req-2b5f78ad-181a-4999-a54d-55ed02506d7c service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f32f244e-c11b-4462-b004-f3965f86ad0a req-2b5f78ad-181a-4999-a54d-55ed02506d7c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:20 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f32f244e-c11b-4462-b004-f3965f86ad0a req-2b5f78ad-181a-4999-a54d-55ed02506d7c service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:20 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-f32f244e-c11b-4462-b004-f3965f86ad0a req-2b5f78ad-181a-4999-a54d-55ed02506d7c service nova] Creating event network-changed:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:20:20 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-f32f244e-c11b-4462-b004-f3965f86ad0a req-2b5f78ad-181a-4999-a54d-55ed02506d7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066233 Apr 24 00:20:20 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 126/366] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:22 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-71a3e93f-1a4b-400d-bb85-a45db2ec1e34 req-2afde192-201f-4ada-b038-ed8b6487af8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "name": "network-vif-plugged", "status": "completed", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-71a3e93f-1a4b-400d-bb85-a45db2ec1e34 req-2afde192-201f-4ada-b038-ed8b6487af8e service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-71a3e93f-1a4b-400d-bb85-a45db2ec1e34 req-2afde192-201f-4ada-b038-ed8b6487af8e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:22 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-71a3e93f-1a4b-400d-bb85-a45db2ec1e34 req-2afde192-201f-4ada-b038-ed8b6487af8e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:22 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-71a3e93f-1a4b-400d-bb85-a45db2ec1e34 req-2afde192-201f-4ada-b038-ed8b6487af8e service nova] Creating event network-vif-plugged:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:20:22 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-71a3e93f-1a4b-400d-bb85-a45db2ec1e34 req-2afde192-201f-4ada-b038-ed8b6487af8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Apr 24 00:20:22 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 120/367] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:24 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-68187b63-c874-49c3-a643-5f5253ee886a req-d4fbd00f-847c-40b1-89b5-b81a14fb45ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "name": "network-vif-plugged", "status": "completed", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:20:24 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-68187b63-c874-49c3-a643-5f5253ee886a req-d4fbd00f-847c-40b1-89b5-b81a14fb45ac service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:24 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-68187b63-c874-49c3-a643-5f5253ee886a req-d4fbd00f-847c-40b1-89b5-b81a14fb45ac service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:24 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-68187b63-c874-49c3-a643-5f5253ee886a req-d4fbd00f-847c-40b1-89b5-b81a14fb45ac service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:24 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-68187b63-c874-49c3-a643-5f5253ee886a req-d4fbd00f-847c-40b1-89b5-b81a14fb45ac service nova] Creating event network-vif-plugged:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:20:24 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-68187b63-c874-49c3-a643-5f5253ee886a req-d4fbd00f-847c-40b1-89b5-b81a14fb45ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029615 Apr 24 00:20:24 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 122/368] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:20:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] [instance: 1728a086-3a73-4157-8c2f-3606820448a9] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:28 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] HTTP exception thrown: Instance 1728a086-3a73-4157-8c2f-3606820448a9 could not be found. Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Request method failure captured: Apr 24 00:20:28 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 HTTP/1.1 Apr 24 00:20:28 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:20:28 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:20:28 user devstack@n-api.service[61492]: Connection: close Apr 24 00:20:28 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:20:28 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:20:28 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:20:28 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:20:28 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcqfHyeSD9Zw2nW1HATD4GMsd93PcpT7W1eGD7EH5kh468ymr90tD-D4Oz41pC0wvUyADZDeKNGC6M2bCyPRpghtEIe0J1jh7W9il-89rQg9TqnGY1TsyWQczdxmyhY6hDlj-O6RGvTnLZLuZgGLcFndkTPRX2NOZ9LBAoYEBlqIxpw Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Project-Id: 9011aa88afdb40f4be4c2e9846fa72dd Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Project-Name: tempest-SnapshotDataIntegrityTests-901788601 Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9011aa88afdb40f4be4c2e9846fa72dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9011aa88afdb40f4be4c2e9846fa72dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9011aa88afdb40f4be4c2e9846fa72dd"}]}] Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Tenant: tempest-SnapshotDataIntegrityTests-901788601 Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Tenant-Id: 9011aa88afdb40f4be4c2e9846fa72dd Apr 24 00:20:28 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-901788601 Apr 24 00:20:28 user devstack@n-api.service[61492]: X-User: tempest-SnapshotDataIntegrityTests-901788601-project-member Apr 24 00:20:28 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:20:28 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:20:28 user devstack@n-api.service[61492]: X-User-Id: 4192d379850d40c5b684d8835548acd5 Apr 24 00:20:28 user devstack@n-api.service[61492]: X-User-Name: tempest-SnapshotDataIntegrityTests-901788601-project-member Apr 24 00:20:28 user devstack@n-api.service[61492]: method: > Apr 24 00:20:28 user devstack@n-api.service[61492]: exception: Instance 1728a086-3a73-4157-8c2f-3606820448a9 could not be found. Apr 24 00:20:28 user devstack@n-api.service[61492]: action_args: {'id': '1728a086-3a73-4157-8c2f-3606820448a9'} Apr 24 00:20:28 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1728a086-3a73-4157-8c2f-3606820448a9 could not be found. Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1728a086-3a73-4157-8c2f-3606820448a9 could not be found. Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1728a086-3a73-4157-8c2f-3606820448a9 could not be found. Apr 24 00:20:28 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:28 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Returning 404 to user: Instance 1728a086-3a73-4157-8c2f-3606820448a9 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:20:28 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-968467fa-452d-432c-af8e-6d5916940d94 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9" status: 404 len: 111 microversion: 2.1 time: 0.048555 Apr 24 00:20:28 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 127/369] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:28 2023] GET /compute/v2.1/servers/1728a086-3a73-4157-8c2f-3606820448a9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:20:28 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:28 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:28 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-4d6ab5d3-d9c1-4124-84c5-db9f4de99873 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] Calling method '.version_select at 0x7fc8c3765510>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:28 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-4d6ab5d3-d9c1-4124-84c5-db9f4de99873 tempest-SnapshotDataIntegrityTests-901788601 tempest-SnapshotDataIntegrityTests-901788601-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1799058279" status: 202 len: 0 microversion: 2.1 time: 0.159455 Apr 24 00:20:28 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 121/370] 10.0.0.210 () {62 vars in 1355 bytes} [Mon Apr 24 00:20:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1799058279 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:42 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:20:42 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-96c4bbe9-64e3-4ab8-8969-1301e4741321 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.243550 Apr 24 00:20:42 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 123/371] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:42 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] [instance: c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] HTTP exception thrown: Instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b could not be found. Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Request method failure captured: Apr 24 00:20:47 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b HTTP/1.1 Apr 24 00:20:47 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:20:47 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:20:47 user devstack@n-api.service[61492]: Connection: close Apr 24 00:20:47 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:20:47 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:20:47 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:20:47 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:20:47 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcks9jIUpJseB24-8cTq-FqbEDKIROUOEAF7JNU4Rnmey_q6uim9Me6xO25MvzT8gYSzs3B2QVrDC7uDGPpqmM1MBIiIHDJlC-Sbvh-FAY65lwcd_YYbyiLvEk6be4GT0CxJl1HJBeyWhjfIDMUzSd--u056bsfyKH5X-FZOyqRQm6g Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Openstack-Nova-Api-Version: 2.87 Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Project-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d26ba1ed4b9241f9a084db1a14a945bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d26ba1ed4b9241f9a084db1a14a945bb"}]}] Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Tenant-Id: d26ba1ed4b9241f9a084db1a14a945bb Apr 24 00:20:47 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443 Apr 24 00:20:47 user devstack@n-api.service[61492]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:20:47 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:20:47 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:20:47 user devstack@n-api.service[61492]: X-User-Id: 8d0ab07106dd4995aa7e3f5b6bc70e56 Apr 24 00:20:47 user devstack@n-api.service[61492]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member Apr 24 00:20:47 user devstack@n-api.service[61492]: method: > Apr 24 00:20:47 user devstack@n-api.service[61492]: exception: Instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b could not be found. Apr 24 00:20:47 user devstack@n-api.service[61492]: action_args: {'id': 'c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b'} Apr 24 00:20:47 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b could not be found. Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b could not be found. Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b could not be found. Apr 24 00:20:47 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:20:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] Returning 404 to user: Instance c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:20:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-191cf769-55f0-4400-931e-75113699599b tempest-ServerBootFromVolumeStableRescueTest-2021792443 tempest-ServerBootFromVolumeStableRescueTest-2021792443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b" status: 404 len: 111 microversion: 2.87 time: 0.039038 Apr 24 00:20:47 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 128/372] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 24 00:20:47 2023] GET /compute/v2.1/servers/c4ed916c-8dc9-4fbd-a18f-ca7428e80f5b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] [instance: ce19423d-a6ee-4506-9cd1-ec4803abdd86] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:20:50 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:20:51 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] HTTP exception thrown: Instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 could not be found. Apr 24 00:20:51 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Request method failure captured: Apr 24 00:20:51 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 HTTP/1.1 Apr 24 00:20:51 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:20:51 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:20:51 user devstack@n-api.service[61491]: Connection: close Apr 24 00:20:51 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:20:51 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:20:51 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:20:51 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:20:51 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcknbEbJiLaFKm-Vp8fpFWaMYaeIMVlEum0rC_gcob1n4C2qD4-3OOTg19oE0ATJIKi-8M210PiwwRlLExga5iD7yuFvGLgT6t3N4tVMG-LbvilQDesbm_9IWJCRWoEzFQ2ZybiFE2hp3YXndKdLHaoMgduJRyPUK24AUWMYCvD2ZFI Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Project-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Project-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce75f63fc0904eceb03e8319bddba4d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce75f63fc0904eceb03e8319bddba4d3"}]}] Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Tenant: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Tenant-Id: ce75f63fc0904eceb03e8319bddba4d3 Apr 24 00:20:51 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-380105770 Apr 24 00:20:51 user devstack@n-api.service[61491]: X-User: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:20:51 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:20:51 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:20:51 user devstack@n-api.service[61491]: X-User-Id: abae98323deb44dea0622186485cc7af Apr 24 00:20:51 user devstack@n-api.service[61491]: X-User-Name: tempest-ServersNegativeTestJSON-380105770-project-member Apr 24 00:20:51 user devstack@n-api.service[61491]: method: > Apr 24 00:20:51 user devstack@n-api.service[61491]: exception: Instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 could not be found. Apr 24 00:20:51 user devstack@n-api.service[61491]: action_args: {'id': 'ce19423d-a6ee-4506-9cd1-ec4803abdd86'} Apr 24 00:20:51 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 could not be found. Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 could not be found. Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 could not be found. Apr 24 00:20:51 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:20:51 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] Returning 404 to user: Instance ce19423d-a6ee-4506-9cd1-ec4803abdd86 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:20:51 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-fa412582-047e-45d3-b0be-4a6684fb5fbe tempest-ServersNegativeTestJSON-380105770 tempest-ServersNegativeTestJSON-380105770-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86" status: 404 len: 111 microversion: 2.1 time: 0.046430 Apr 24 00:20:51 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 122/373] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:20:50 2023] GET /compute/v2.1/servers/ce19423d-a6ee-4506-9cd1-ec4803abdd86 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:07 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:08 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:21:08 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-28a3f435-2083-4175-b89b-d587d7355385 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 200 len: 1544 microversion: 2.1 time: 0.365109 Apr 24 00:21:08 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 124/374] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:21:07 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 1544 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:42 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:21:42 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-6c9bd75d-ea37-4ef9-b665-442fd6a83203 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.442235 Apr 24 00:21:42 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 129/375] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:21:42 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:21:42 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:21:42 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:21:42 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:43 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:21:43 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-7d0590ff-4403-4572-9c5e-e99a7d25a0b4 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.279401 Apr 24 00:21:43 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 123/376] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:21:42 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:21:43 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:21:43 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-b9770097-4d5c-48df-acfb-1d4300d47b35 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.159551 Apr 24 00:21:43 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 125/377] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:21:43 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:08 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-27bd911b-ca77-4ba9-9cd9-033abb597fa9 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.175526 Apr 24 00:22:08 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 130/378] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:22:08 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0/os-interface => generated 282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:22:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:09 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:09 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:09 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-a315d698-58d7-4576-b7f7-f868b6f4f160 req-1d92c2a9-f9a6-438a-a543-3a2278a7bb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:22:09 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-45c727a0-aefb-4336-a1d9-a7848df153b1 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0/ips" status: 200 len: 107 microversion: 2.1 time: 0.039003 Apr 24 00:22:09 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 126/379] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:22:09 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0/ips => generated 107 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:22:09 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-a315d698-58d7-4576-b7f7-f868b6f4f160 req-1d92c2a9-f9a6-438a-a543-3a2278a7bb1d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:09 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-a315d698-58d7-4576-b7f7-f868b6f4f160 req-1d92c2a9-f9a6-438a-a543-3a2278a7bb1d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:09 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-a315d698-58d7-4576-b7f7-f868b6f4f160 req-1d92c2a9-f9a6-438a-a543-3a2278a7bb1d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:09 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-a315d698-58d7-4576-b7f7-f868b6f4f160 req-1d92c2a9-f9a6-438a-a543-3a2278a7bb1d service nova] Creating event network-changed:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:22:09 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-a315d698-58d7-4576-b7f7-f868b6f4f160 req-1d92c2a9-f9a6-438a-a543-3a2278a7bb1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101094 Apr 24 00:22:09 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 124/380] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:22:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:10 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:22:10 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-33a1d966-bdd3-454d-bdf6-e00a453d939a tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 204 len: 0 microversion: 2.1 time: 0.114325 Apr 24 00:22:10 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 131/381] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:22:10 2023] DELETE /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:10 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35edcadbe77c4f4fa8304216e7f61d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d1e8a757a746329ea363af81a3c6b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:22:10 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-ebfc74af-1b21-4a09-ad21-e2f466158b8c tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 200 len: 1669 microversion: 2.1 time: 0.240838 Apr 24 00:22:10 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:22:10 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 1669 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:22:10 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-299acf93-6cd9-44e9-af0d-7b8daab21fa3 req-2eefd53d-783f-4b5c-a959-862372cc63ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "name": "network-vif-unplugged", "status": "completed", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:22:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-299acf93-6cd9-44e9-af0d-7b8daab21fa3 req-2eefd53d-783f-4b5c-a959-862372cc63ad service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-299acf93-6cd9-44e9-af0d-7b8daab21fa3 req-2eefd53d-783f-4b5c-a959-862372cc63ad service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:10 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-299acf93-6cd9-44e9-af0d-7b8daab21fa3 req-2eefd53d-783f-4b5c-a959-862372cc63ad service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:10 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-299acf93-6cd9-44e9-af0d-7b8daab21fa3 req-2eefd53d-783f-4b5c-a959-862372cc63ad service nova] Creating event network-vif-unplugged:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:22:10 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-299acf93-6cd9-44e9-af0d-7b8daab21fa3 req-2eefd53d-783f-4b5c-a959-862372cc63ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033326 Apr 24 00:22:10 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 125/383] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:22:12 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "name": "network-vif-plugged", "status": "completed", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}, {"server_uuid": "88bc0884-174c-402c-9cbd-7099895f27a0", "name": "network-vif-deleted", "tag": "904cb737-715a-45a2-8c4e-e99e90596e6e"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:22:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:12 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:12 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] Creating event network-vif-plugged:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:22:12 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] Creating event network-vif-deleted:904cb737-715a-45a2-8c4e-e99e90596e6e for instance 88bc0884-174c-402c-9cbd-7099895f27a0 on user Apr 24 00:22:12 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-e686d26b-2093-4ccd-b12e-0926dcc6312b req-d52e258c-ee17-42b7-a297-da0ce85dfdf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034886 Apr 24 00:22:12 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 132/384] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=10 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:22:45 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:22:45 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-caa8deb7-1410-40f3-8ebe-b373f06f89b3 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1656 microversion: 2.1 time: 0.227799 Apr 24 00:22:45 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:22:45 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1656 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:00 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 HTTP/1.1 Apr 24 00:23:00 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:23:00 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:23:00 user devstack@n-api.service[61491]: Connection: close Apr 24 00:23:00 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:23:00 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:23:00 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:23:00 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:23:00 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:00 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:00 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:00 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:23:00 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:23:00 user devstack@n-api.service[61491]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:00 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:00 user devstack@n-api.service[61491]: method: > Apr 24 00:23:00 user devstack@n-api.service[61491]: exception: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:00 user devstack@n-api.service[61491]: action_args: {'id': '88bc0884-174c-402c-9cbd-7099895f27a0'} Apr 24 00:23:00 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:00 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:00 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:00 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-998a5580-7902-4c52-8d78-1bc4a8b48e66 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 404 len: 111 microversion: 2.1 time: 0.031882 Apr 24 00:23:00 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 126/386] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:23:00 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:00 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:00 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:00 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-37fdc0d0-fe09-4bba-a87d-a829d9f6d710 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '.version_select at 0x7fc8c3629c60>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-37fdc0d0-fe09-4bba-a87d-a829d9f6d710 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028661157" status: 202 len: 0 microversion: 2.1 time: 0.032785 Apr 24 00:23:00 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 133/387] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 24 00:23:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028661157 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:01 user devstack@n-api.service[61493]: request: DELETE /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 HTTP/1.1 Apr 24 00:23:01 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:23:01 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:23:01 user devstack@n-api.service[61493]: Connection: close Apr 24 00:23:01 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:23:01 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:23:01 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:23:01 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:23:01 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61493]: method: > Apr 24 00:23:01 user devstack@n-api.service[61493]: exception: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: action_args: {'id': '88bc0884-174c-402c-9cbd-7099895f27a0'} Apr 24 00:23:01 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:01 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-977b8041-8aea-41e7-a56c-610c07255986 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 404 len: 111 microversion: 2.1 time: 0.031475 Apr 24 00:23:01 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 129/388] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:23:01 2023] DELETE /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 88bc0884-174c-402c-9cbd-7099895f27a0] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:01 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 HTTP/1.1 Apr 24 00:23:01 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:23:01 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:23:01 user devstack@n-api.service[61491]: Connection: close Apr 24 00:23:01 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:23:01 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:23:01 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:23:01 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:23:01 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61491]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:01 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61491]: method: > Apr 24 00:23:01 user devstack@n-api.service[61491]: exception: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61491]: action_args: {'id': '88bc0884-174c-402c-9cbd-7099895f27a0'} Apr 24 00:23:01 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance 88bc0884-174c-402c-9cbd-7099895f27a0 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:01 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-98fda54d-809d-4dd4-a414-621a28b430a0 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0" status: 404 len: 111 microversion: 2.1 time: 0.026311 Apr 24 00:23:01 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 127/389] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:23:01 2023] GET /compute/v2.1/servers/88bc0884-174c-402c-9cbd-7099895f27a0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:01 user devstack@n-api.service[61492]: request: DELETE /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 HTTP/1.1 Apr 24 00:23:01 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:23:01 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:23:01 user devstack@n-api.service[61492]: Connection: close Apr 24 00:23:01 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:23:01 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:23:01 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:23:01 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:23:01 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61492]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:01 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61492]: method: > Apr 24 00:23:01 user devstack@n-api.service[61492]: exception: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61492]: action_args: {'id': 'a2e58fac-ff2d-47e5-866d-de1f2b741cb3'} Apr 24 00:23:01 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:01 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-b1053f77-ba52-441d-9718-6b99688dd8ad tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 404 len: 111 microversion: 2.1 time: 0.042011 Apr 24 00:23:01 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 134/390] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:23:01 2023] DELETE /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: a2e58fac-ff2d-47e5-866d-de1f2b741cb3] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:01 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:01 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 HTTP/1.1 Apr 24 00:23:01 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:23:01 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:23:01 user devstack@n-api.service[61493]: Connection: close Apr 24 00:23:01 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:23:01 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:23:01 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:23:01 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:23:01 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:01 user devstack@n-api.service[61493]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:01 user devstack@n-api.service[61493]: method: > Apr 24 00:23:01 user devstack@n-api.service[61493]: exception: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: action_args: {'id': 'a2e58fac-ff2d-47e5-866d-de1f2b741cb3'} Apr 24 00:23:01 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. Apr 24 00:23:01 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:23:01 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance a2e58fac-ff2d-47e5-866d-de1f2b741cb3 could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:01 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-ce3e5ed6-5e1f-4d92-b11b-f4d32fe48418 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3" status: 404 len: 111 microversion: 2.1 time: 0.032631 Apr 24 00:23:01 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:23:01 2023] GET /compute/v2.1/servers/a2e58fac-ff2d-47e5-866d-de1f2b741cb3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:02 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:02 user devstack@n-api.service[61491]: request: DELETE /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 HTTP/1.1 Apr 24 00:23:02 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:23:02 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:23:02 user devstack@n-api.service[61491]: Connection: close Apr 24 00:23:02 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:23:02 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:23:02 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:23:02 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:23:02 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:02 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:02 user devstack@n-api.service[61491]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:02 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:23:02 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:23:02 user devstack@n-api.service[61491]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:02 user devstack@n-api.service[61491]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:02 user devstack@n-api.service[61491]: method: > Apr 24 00:23:02 user devstack@n-api.service[61491]: exception: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61491]: action_args: {'id': '43f004f3-9b3f-4388-88a8-8eb663ba36a3'} Apr 24 00:23:02 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:02 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-fa6c45dd-a21f-4c1a-8c5b-73ab6bed2101 tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 404 len: 111 microversion: 2.1 time: 0.036383 Apr 24 00:23:02 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 128/392] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:23:02 2023] DELETE /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] [instance: 43f004f3-9b3f-4388-88a8-8eb663ba36a3] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] HTTP exception thrown: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Request method failure captured: Apr 24 00:23:02 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 HTTP/1.1 Apr 24 00:23:02 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:23:02 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:23:02 user devstack@n-api.service[61492]: Connection: close Apr 24 00:23:02 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:23:02 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:23:02 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:23:02 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:23:02 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRcnwAVtBQnKZbq5P8MgnzkKze4qcBd_MzpNaJQWry25UQZeuZaieEnDkEPio-zR32OsQ4QFajWnWBKvTxrErJ-5qQq4KGQZJ6HcsYFe0aubhOEJDgAU8kXzphP6tfAA2hQFL3AKb9jY9n9KWDkIpzVhEO3Ktp0hBamverHpfcHKFm4s Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Project-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Project-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97d1e8a757a746329ea363af81a3c6b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97d1e8a757a746329ea363af81a3c6b4"}]}] Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Tenant: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Tenant-Id: 97d1e8a757a746329ea363af81a3c6b4 Apr 24 00:23:02 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272859998 Apr 24 00:23:02 user devstack@n-api.service[61492]: X-User: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:02 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:23:02 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:23:02 user devstack@n-api.service[61492]: X-User-Id: 35edcadbe77c4f4fa8304216e7f61d4a Apr 24 00:23:02 user devstack@n-api.service[61492]: X-User-Name: tempest-AttachVolumeNegativeTest-272859998-project-member Apr 24 00:23:02 user devstack@n-api.service[61492]: method: > Apr 24 00:23:02 user devstack@n-api.service[61492]: exception: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61492]: action_args: {'id': '43f004f3-9b3f-4388-88a8-8eb663ba36a3'} Apr 24 00:23:02 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. Apr 24 00:23:02 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:23:02 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] Returning 404 to user: Instance 43f004f3-9b3f-4388-88a8-8eb663ba36a3 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:02 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8dbc8376-b1dc-4ee4-b931-7b87de06e58b tempest-AttachVolumeNegativeTest-272859998 tempest-AttachVolumeNegativeTest-272859998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3" status: 404 len: 111 microversion: 2.1 time: 0.029482 Apr 24 00:23:02 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 135/393] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:23:02 2023] GET /compute/v2.1/servers/43f004f3-9b3f-4388-88a8-8eb663ba36a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:06 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-461d0e8e-4d67-4776-93ce-6a8d7f0cc91c tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Action: 'create', calling method: .version_select at 0x7fc8c38af250>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1858569274", "metadata": {"Type": "work"}}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:23:07 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-461d0e8e-4d67-4776-93ce-6a8d7f0cc91c tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.480506 Apr 24 00:23:07 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 131/394] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 24 00:23:06 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 483 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 24 00:23:07 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-335af625-5e5b-4508-a6dc-ea7a5034a418 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Calling method '.version_select at 0x7fc8c3766b00>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:07 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-335af625-5e5b-4508-a6dc-ea7a5034a418 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04" status: 200 len: 350 microversion: 2.1 time: 0.057104 Apr 24 00:23:07 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 129/395] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:23:07 2023] GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:23:08 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-07a6bb11-bd73-48b8-97af-0343cbf10b4b tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Calling method '.version_select at 0x7fc8c3629120>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:08 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-07a6bb11-bd73-48b8-97af-0343cbf10b4b tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04" status: 200 len: 350 microversion: 2.1 time: 0.065111 Apr 24 00:23:08 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 136/396] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:23:08 2023] GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:23:08 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-543651d2-7713-4c60-ad24-e2cbc27fb611 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Calling method '.version_select at 0x7fc8c38ac040>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:08 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-543651d2-7713-4c60-ad24-e2cbc27fb611 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04" status: 202 len: 0 microversion: 2.1 time: 0.188138 Apr 24 00:23:08 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 24 00:23:08 2023] DELETE /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:23:08 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-3fe354e3-716a-4563-8996-ab4c87e87c83 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Calling method '.version_select at 0x7fc8c3765b40>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:08 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-3fe354e3-716a-4563-8996-ab4c87e87c83 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] HTTP exception thrown: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. Apr 24 00:23:08 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-3fe354e3-716a-4563-8996-ab4c87e87c83 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Request method failure captured: Apr 24 00:23:08 user devstack@n-api.service[61491]: request: GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04 HTTP/1.1 Apr 24 00:23:08 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:23:08 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:23:08 user devstack@n-api.service[61491]: Connection: close Apr 24 00:23:08 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:23:08 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:23:08 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:23:08 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:23:08 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcvqdyAXTUrIf_4CUEFmtJ8T4GO6oMv3yYCF4GoG0yKYouFAFcvHnjd8tLElK_Di7iqiy0sZNsnrdSG0_q8jMvjgJD4BlPOpX1q57gB0Y_OHXxI8-gf7KT-m8hKrJZs1VmFMr-oDvt3WUuRna67Ktd49SqoCfXYlEFJmbxoToK3kBas Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Project-Id: 92d0f0b423594e279735fd91379cbb08 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Project-Name: tempest-VolumesGetTestJSON-31498918 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92d0f0b423594e279735fd91379cbb08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92d0f0b423594e279735fd91379cbb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/92d0f0b423594e279735fd91379cbb08"}]}] Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Tenant: tempest-VolumesGetTestJSON-31498918 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Tenant-Id: 92d0f0b423594e279735fd91379cbb08 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-VolumesGetTestJSON-31498918 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-User: tempest-VolumesGetTestJSON-31498918-project-member Apr 24 00:23:08 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:23:08 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:23:08 user devstack@n-api.service[61491]: X-User-Id: 68d884f38f394aeba25c3e5be3159102 Apr 24 00:23:08 user devstack@n-api.service[61491]: X-User-Name: tempest-VolumesGetTestJSON-31498918-project-member Apr 24 00:23:08 user devstack@n-api.service[61491]: method: Apr 24 00:23:08 user devstack@n-api.service[61491]: exception: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. Apr 24 00:23:08 user devstack@n-api.service[61491]: action_args: {'id': '3d266ee7-02f5-420e-996c-82f2dd65bb04'} Apr 24 00:23:08 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. (HTTP 404) (Request-ID: req-e081a1a1-2936-42b7-9c02-a37a79593b03) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. Apr 24 00:23:08 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:23:08 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-3fe354e3-716a-4563-8996-ab4c87e87c83 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] Returning 404 to user: Volume 3d266ee7-02f5-420e-996c-82f2dd65bb04 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:23:08 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-3fe354e3-716a-4563-8996-ab4c87e87c83 tempest-VolumesGetTestJSON-31498918 tempest-VolumesGetTestJSON-31498918-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04" status: 404 len: 109 microversion: 2.1 time: 0.035721 Apr 24 00:23:08 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 130/398] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 24 00:23:08 2023] GET /compute/v2.1/os-volumes/3d266ee7-02f5-420e-996c-82f2dd65bb04 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:45 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Going to try to terminate instance {{(pid=61492) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:23:45 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-4d1caed8-0fa9-4aa4-95ae-3083ef0d4348 tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 204 len: 0 microversion: 2.1 time: 0.126504 Apr 24 00:23:45 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 137/399] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:23:45 2023] DELETE /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:45 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:46 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8536b0b100af4c81b0114b37a10ec017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211ed190ee5c4a0b98b85960339ea437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:23:46 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-26c993ed-be10-4533-89f9-1272643b224e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 200 len: 1662 microversion: 2.1 time: 0.356303 Apr 24 00:23:46 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 133/400] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:23:45 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 1662 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:23:46 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:46 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:23:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-8de4c66c-ff8e-4fd8-aa3d-3d17192a2465 req-86c30afc-18d5-43b0-afdb-c86924fa7df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-unplugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:23:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-8de4c66c-ff8e-4fd8-aa3d-3d17192a2465 req-86c30afc-18d5-43b0-afdb-c86924fa7df3 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-8de4c66c-ff8e-4fd8-aa3d-3d17192a2465 req-86c30afc-18d5-43b0-afdb-c86924fa7df3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:46 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-8de4c66c-ff8e-4fd8-aa3d-3d17192a2465 req-86c30afc-18d5-43b0-afdb-c86924fa7df3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-8de4c66c-ff8e-4fd8-aa3d-3d17192a2465 req-86c30afc-18d5-43b0-afdb-c86924fa7df3 service nova] Creating event network-vif-unplugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:46 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-8de4c66c-ff8e-4fd8-aa3d-3d17192a2465 req-86c30afc-18d5-43b0-afdb-c86924fa7df3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.220769 Apr 24 00:23:46 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 131/401] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:23:47 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-a2e53f91-3c77-45eb-a463-81b56a8d5f44 req-6dad18e6-8ecd-44c8-8636-18d8391d30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-deleted", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:23:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a2e53f91-3c77-45eb-a463-81b56a8d5f44 req-6dad18e6-8ecd-44c8-8636-18d8391d30d3 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a2e53f91-3c77-45eb-a463-81b56a8d5f44 req-6dad18e6-8ecd-44c8-8636-18d8391d30d3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:47 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a2e53f91-3c77-45eb-a463-81b56a8d5f44 req-6dad18e6-8ecd-44c8-8636-18d8391d30d3 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-a2e53f91-3c77-45eb-a463-81b56a8d5f44 req-6dad18e6-8ecd-44c8-8636-18d8391d30d3 service nova] Creating event network-vif-deleted:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:47 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-a2e53f91-3c77-45eb-a463-81b56a8d5f44 req-6dad18e6-8ecd-44c8-8636-18d8391d30d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146933 Apr 24 00:23:47 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 138/402] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:23:48 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-plugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}, {"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-plugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}, {"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-plugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}, {"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-unplugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}, {"server_uuid": "cf2c88d5-8347-4166-a037-158f29c32d1a", "name": "network-vif-plugged", "status": "completed", "tag": "783a3713-64fb-48f3-b3ba-0312249006eb"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:23:48 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:23:48 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:23:48 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:23:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Creating event network-vif-plugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Creating event network-vif-plugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Creating event network-vif-plugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Creating event network-vif-unplugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] Creating event network-vif-plugged:783a3713-64fb-48f3-b3ba-0312249006eb for instance cf2c88d5-8347-4166-a037-158f29c32d1a on user Apr 24 00:23:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-bf2148f3-8019-4cb9-808d-bb908047a6be req-a2f0aa3b-7d77-4fc3-9c2b-9c4b48535e08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040872 Apr 24 00:23:48 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 134/403] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:36 user devstack@n-api.service[61491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 24 00:24:36 user devstack@n-api.service[61491]: Mon Apr 24 00:24:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a (ip 10.0.0.210) !!! Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] [instance: cf2c88d5-8347-4166-a037-158f29c32d1a] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] HTTP exception thrown: Instance cf2c88d5-8347-4166-a037-158f29c32d1a could not be found. Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Request method failure captured: Apr 24 00:24:36 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a HTTP/1.1 Apr 24 00:24:36 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:24:36 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:24:36 user devstack@n-api.service[61491]: Connection: close Apr 24 00:24:36 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:24:36 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:24:36 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:24:36 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:24:36 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRcn9AWZvti9nbdTfn3I8JV7l805-iuS3qGjMTkV10ByY7Oij-xGmH_AbKJM56Qr3GA2zTr7IE7K6VL6PQATTuEzwXRBm8Ird7y_CHbJl8G_QVcbkHwhqmwGbu90qXcfaNapIvcs-Ytrxyh24EIR4aebcaBOUQfWcKyYwZFYFvhuRXWE Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Project-Id: 211ed190ee5c4a0b98b85960339ea437 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Project-Name: tempest-ServerActionsTestJSON-1785200975 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/211ed190ee5c4a0b98b85960339ea437"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/211ed190ee5c4a0b98b85960339ea437"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/211ed190ee5c4a0b98b85960339ea437"}]}] Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Tenant: tempest-ServerActionsTestJSON-1785200975 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Tenant-Id: 211ed190ee5c4a0b98b85960339ea437 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-ServerActionsTestJSON-1785200975 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-User: tempest-ServerActionsTestJSON-1785200975-project-member Apr 24 00:24:36 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:24:36 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:24:36 user devstack@n-api.service[61491]: X-User-Id: 8536b0b100af4c81b0114b37a10ec017 Apr 24 00:24:36 user devstack@n-api.service[61491]: X-User-Name: tempest-ServerActionsTestJSON-1785200975-project-member Apr 24 00:24:36 user devstack@n-api.service[61491]: method: > Apr 24 00:24:36 user devstack@n-api.service[61491]: exception: Instance cf2c88d5-8347-4166-a037-158f29c32d1a could not be found. Apr 24 00:24:36 user devstack@n-api.service[61491]: action_args: {'id': 'cf2c88d5-8347-4166-a037-158f29c32d1a'} Apr 24 00:24:36 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2c88d5-8347-4166-a037-158f29c32d1a could not be found. Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2c88d5-8347-4166-a037-158f29c32d1a could not be found. Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2c88d5-8347-4166-a037-158f29c32d1a could not be found. Apr 24 00:24:36 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:24:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Returning 404 to user: Instance cf2c88d5-8347-4166-a037-158f29c32d1a could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:24:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-2d125a86-4676-4a2c-95b0-9c7e8b0650ad tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a" status: 404 len: 111 microversion: 2.1 time: 0.045649 Apr 24 00:24:36 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 132/404] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:24:36 2023] GET /compute/v2.1/servers/cf2c88d5-8347-4166-a037-158f29c32d1a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:24:36 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:36 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:36 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-db862d50-114d-4e17-8b4f-d057ea6cfe0e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] Calling method '.version_select at 0x7fc8c3628dc0>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:24:36 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-db862d50-114d-4e17-8b4f-d057ea6cfe0e tempest-ServerActionsTestJSON-1785200975 tempest-ServerActionsTestJSON-1785200975-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442678964" status: 202 len: 0 microversion: 2.1 time: 0.033000 Apr 24 00:24:36 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 139/405] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 24 00:24:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442678964 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:24:48 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:48 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=8 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:48 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-e987145a-e584-492f-9c1f-a69de6ee175c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3a44ee0>, body: {"keypair": {"name": "tempest-keypair-1862289859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIM4N11geMCFNlqf+WumRT8Io9+APZabKwlT29VAkxGMpvYD7hEgMyCcPGCln3NuH+chYQtwvDTqcXB35chovwequeYHVWAICGxNgGLzMB8oEjcCJdDttXbnQwU4HFcCw=="}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:24:48 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-e987145a-e584-492f-9c1f-a69de6ee175c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Getting quotas for project ffcdb2ab0e4145ad988f91b13ebd629e. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:24:48 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-e987145a-e584-492f-9c1f-a69de6ee175c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Getting quotas for user 61677897acda43ca83dd2c702e6e5eb5 and project ffcdb2ab0e4145ad988f91b13ebd629e. Resources: {'key_pairs'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:24:48 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-e987145a-e584-492f-9c1f-a69de6ee175c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165726 Apr 24 00:24:48 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 135/406] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:24:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:24:50 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-269082558", "imageRef": "fcf09ead-c5af-40cc-b5cf-92626e181ef9", "flavorRef": "42", "networks": [{"uuid": "01988cc6-152f-4948-9028-cb1f71426e3c"}], "security_groups": [{"name": "tempest-securitygroup--1746947476"}], "key_name": "tempest-keypair-1862289859", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:24:50 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:50 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:50 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] validate_networks() for [('01988cc6-152f-4948-9028-cb1f71426e3c', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Getting quotas for project ffcdb2ab0e4145ad988f91b13ebd629e. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Getting quotas for user 61677897acda43ca83dd2c702e6e5eb5 and project ffcdb2ab0e4145ad988f91b13ebd629e. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:24:51 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcf09ead-c5af-40cc-b5cf-92626e181ef9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:24:51 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-65d0ef01-4a23-42ff-be50-cc8c7cc2715c tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.845889 Apr 24 00:24:51 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 133/407] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:24:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:24:51 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:24:51 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-5816ca7a-2cdf-4450-83f3-585ae3dc5350 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:24:51 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-5816ca7a-2cdf-4450-83f3-585ae3dc5350 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:24:51 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-5816ca7a-2cdf-4450-83f3-585ae3dc5350 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61677897acda43ca83dd2c702e6e5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcdb2ab0e4145ad988f91b13ebd629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:24:51 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-5816ca7a-2cdf-4450-83f3-585ae3dc5350 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 200 len: 1239 microversion: 2.1 time: 0.074733 Apr 24 00:24:51 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 140/408] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:24:51 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:24:53 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-0a7b8ddd-3e72-47a9-b9a1-de99d3d72bfe req-5bf93a52-7ef2-489b-94a8-3afd28dbd9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:24:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0a7b8ddd-3e72-47a9-b9a1-de99d3d72bfe req-5bf93a52-7ef2-489b-94a8-3afd28dbd9e4 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0a7b8ddd-3e72-47a9-b9a1-de99d3d72bfe req-5bf93a52-7ef2-489b-94a8-3afd28dbd9e4 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-0a7b8ddd-3e72-47a9-b9a1-de99d3d72bfe req-5bf93a52-7ef2-489b-94a8-3afd28dbd9e4 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:53 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-0a7b8ddd-3e72-47a9-b9a1-de99d3d72bfe req-5bf93a52-7ef2-489b-94a8-3afd28dbd9e4 service nova] Creating event network-changed:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:24:53 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-0a7b8ddd-3e72-47a9-b9a1-de99d3d72bfe req-5bf93a52-7ef2-489b-94a8-3afd28dbd9e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035722 Apr 24 00:24:53 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:24:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:24:55 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-b4a1542f-385d-443f-813e-55e0f51d6032 req-ac983f8b-ad73-4e0a-b835-28cb7e1d8e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "name": "network-vif-plugged", "status": "completed", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:24:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b4a1542f-385d-443f-813e-55e0f51d6032 req-ac983f8b-ad73-4e0a-b835-28cb7e1d8e87 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b4a1542f-385d-443f-813e-55e0f51d6032 req-ac983f8b-ad73-4e0a-b835-28cb7e1d8e87 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:55 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-b4a1542f-385d-443f-813e-55e0f51d6032 req-ac983f8b-ad73-4e0a-b835-28cb7e1d8e87 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:55 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-b4a1542f-385d-443f-813e-55e0f51d6032 req-ac983f8b-ad73-4e0a-b835-28cb7e1d8e87 service nova] Creating event network-vif-plugged:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:24:55 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-b4a1542f-385d-443f-813e-55e0f51d6032 req-ac983f8b-ad73-4e0a-b835-28cb7e1d8e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045036 Apr 24 00:24:55 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 134/410] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:24:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:24:57 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-ccbd505e-575f-427a-9e5f-a1350a876285 req-52e454d0-0e10-4ce2-988b-70f51a8ca067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "name": "network-vif-plugged", "status": "completed", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:24:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-ccbd505e-575f-427a-9e5f-a1350a876285 req-52e454d0-0e10-4ce2-988b-70f51a8ca067 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:24:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-ccbd505e-575f-427a-9e5f-a1350a876285 req-52e454d0-0e10-4ce2-988b-70f51a8ca067 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:24:57 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-ccbd505e-575f-427a-9e5f-a1350a876285 req-52e454d0-0e10-4ce2-988b-70f51a8ca067 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:24:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-ccbd505e-575f-427a-9e5f-a1350a876285 req-52e454d0-0e10-4ce2-988b-70f51a8ca067 service nova] Creating event network-vif-plugged:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:24:57 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-ccbd505e-575f-427a-9e5f-a1350a876285 req-52e454d0-0e10-4ce2-988b-70f51a8ca067 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030344 Apr 24 00:24:57 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 141/411] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:24:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:25:41 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61677897acda43ca83dd2c702e6e5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcdb2ab0e4145ad988f91b13ebd629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:25:41 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-287da556-e90e-4ea1-918f-11310e22f5d6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 200 len: 1553 microversion: 2.1 time: 0.300632 Apr 24 00:25:41 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 137/412] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:25:41 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 1553 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:26:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:26:41 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-5bddac76-21eb-44ad-a23c-2b3cb5d3f237 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.183850 Apr 24 00:26:41 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 135/413] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 24 00:26:41 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:42 user devstack@n-api.service[61492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 24 00:26:42 user devstack@n-api.service[61492]: Mon Apr 24 00:26:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-f53e834e-6668-4d07-b517-e96ac63508f9 req-3ab33c3f-7343-4b80-80d4-8ed0574bded5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f53e834e-6668-4d07-b517-e96ac63508f9 req-3ab33c3f-7343-4b80-80d4-8ed0574bded5 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f53e834e-6668-4d07-b517-e96ac63508f9 req-3ab33c3f-7343-4b80-80d4-8ed0574bded5 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:26:42 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-f53e834e-6668-4d07-b517-e96ac63508f9 req-3ab33c3f-7343-4b80-80d4-8ed0574bded5 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:26:42 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-f53e834e-6668-4d07-b517-e96ac63508f9 req-3ab33c3f-7343-4b80-80d4-8ed0574bded5 service nova] Creating event network-changed:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:26:42 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-f53e834e-6668-4d07-b517-e96ac63508f9 req-3ab33c3f-7343-4b80-80d4-8ed0574bded5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071106 Apr 24 00:26:42 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 142/414] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2033000621"}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:26:42 user devstack@n-api.service[61493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 24 00:26:42 user devstack@n-api.service[61493]: Mon Apr 24 00:26:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf/action (ip 10.0.0.210) !!! Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:26:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:26:43 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-582a45ec-6935-4e66-95a0-e8ae28bf2e6e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf/action" status: 202 len: 0 microversion: 2.1 time: 1.017733 Apr 24 00:26:43 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 138/415] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 24 00:26:42 2023] POST /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf/action => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 24 00:26:43 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-4d0e938f-0e8b-4589-8570-4e980bba8d92 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '.version_select at 0x7fc8c3766200>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:26:43 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-4d0e938f-0e8b-4589-8570-4e980bba8d92 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618" status: 200 len: 1611 microversion: 2.1 time: 0.108117 Apr 24 00:26:43 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 136/416] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 24 00:26:43 2023] GET /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618 => generated 1611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:27:33 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:27:33 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:27:33 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-af0f94d6-5ead-46a7-a399-afaf933ed485 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '.version_select at 0x7fc8c3628ee0>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:27:33 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-af0f94d6-5ead-46a7-a399-afaf933ed485 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618" status: 200 len: 1725 microversion: 2.1 time: 0.129557 Apr 24 00:27:33 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 143/417] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 24 00:27:33 2023] GET /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618 => generated 1725 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:27:33 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:27:33 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:27:33 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-f6df5aab-1556-4c3a-b44a-aecedaf1f0c5 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '.version_select at 0x7fc8c38acb80>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:27:33 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-f6df5aab-1556-4c3a-b44a-aecedaf1f0c5 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618" status: 200 len: 1725 microversion: 2.1 time: 0.064397 Apr 24 00:27:33 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 24 00:27:33 2023] GET /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618 => generated 1725 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:27:34 user devstack@n-api.service[61491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 24 00:27:34 user devstack@n-api.service[61491]: Mon Apr 24 00:27:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf (ip 10.0.0.210) !!! Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:27:34 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61677897acda43ca83dd2c702e6e5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcdb2ab0e4145ad988f91b13ebd629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:27:34 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-660e6c57-a585-4129-8e5b-bf9fe9bc6785 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 200 len: 1672 microversion: 2.1 time: 0.269339 Apr 24 00:27:34 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 137/419] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:27:34 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:34 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61677897acda43ca83dd2c702e6e5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcdb2ab0e4145ad988f91b13ebd629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:28:34 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-6f7252b6-8b6d-43a3-ae47-25d30590d9c2 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 200 len: 1672 microversion: 2.1 time: 0.282706 Apr 24 00:28:34 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 144/420] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:28:34 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 1672 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:28:36 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-5b5e73c2-e223-45d7-981a-eac63db0e7f6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '.version_select at 0x7fc8c38af250>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:28:36 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-5b5e73c2-e223-45d7-981a-eac63db0e7f6 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618" status: 204 len: 0 microversion: 2.1 time: 0.191967 Apr 24 00:28:36 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:28:36 2023] DELETE /compute/v2.1/images/2df69c6e-df79-46be-9711-c8c6b7a6c618 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:36 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Going to try to terminate instance {{(pid=61491) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:28:36 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-de97c346-2837-426f-afc6-d0f9609e664a tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 204 len: 0 microversion: 2.1 time: 0.129686 Apr 24 00:28:36 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 138/422] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:28:36 2023] DELETE /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:36 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61677897acda43ca83dd2c702e6e5eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcdb2ab0e4145ad988f91b13ebd629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:28:37 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-d7176616-9c90-4d32-b33b-c1816b25ae05 tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 200 len: 1678 microversion: 2.1 time: 0.273347 Apr 24 00:28:37 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 145/423] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:28:36 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:28:37 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-d5b5e18f-b31d-4f83-9440-d6b4f614dcee req-b7d852f6-b7ff-4a22-96db-e105b2725c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "name": "network-vif-unplugged", "status": "completed", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:28:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-d5b5e18f-b31d-4f83-9440-d6b4f614dcee req-b7d852f6-b7ff-4a22-96db-e105b2725c43 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-d5b5e18f-b31d-4f83-9440-d6b4f614dcee req-b7d852f6-b7ff-4a22-96db-e105b2725c43 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:37 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-d5b5e18f-b31d-4f83-9440-d6b4f614dcee req-b7d852f6-b7ff-4a22-96db-e105b2725c43 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:37 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-d5b5e18f-b31d-4f83-9440-d6b4f614dcee req-b7d852f6-b7ff-4a22-96db-e105b2725c43 service nova] Creating event network-vif-unplugged:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:28:37 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-d5b5e18f-b31d-4f83-9440-d6b4f614dcee req-b7d852f6-b7ff-4a22-96db-e105b2725c43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093117 Apr 24 00:28:37 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 141/424] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:28:38 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-465b6b4b-0215-4f6a-a245-2da12a879b2c req-2f52b9a7-d2fe-4c8d-b596-b86499f8f334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "name": "network-vif-deleted", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:28:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-465b6b4b-0215-4f6a-a245-2da12a879b2c req-2f52b9a7-d2fe-4c8d-b596-b86499f8f334 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-465b6b4b-0215-4f6a-a245-2da12a879b2c req-2f52b9a7-d2fe-4c8d-b596-b86499f8f334 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-465b6b4b-0215-4f6a-a245-2da12a879b2c req-2f52b9a7-d2fe-4c8d-b596-b86499f8f334 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:38 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-465b6b4b-0215-4f6a-a245-2da12a879b2c req-2f52b9a7-d2fe-4c8d-b596-b86499f8f334 service nova] Creating event network-vif-deleted:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:28:38 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-465b6b4b-0215-4f6a-a245-2da12a879b2c req-2f52b9a7-d2fe-4c8d-b596-b86499f8f334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029807 Apr 24 00:28:38 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 139/425] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:28:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:28:39 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-9e45c319-8a3b-4641-9915-69b2c9522677 req-eea834f3-b17d-4718-9466-1907f352d48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d60a364-b914-4d2c-8fcc-5944148dcecf", "name": "network-vif-plugged", "status": "completed", "tag": "a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:28:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-9e45c319-8a3b-4641-9915-69b2c9522677 req-eea834f3-b17d-4718-9466-1907f352d48a service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:28:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-9e45c319-8a3b-4641-9915-69b2c9522677 req-eea834f3-b17d-4718-9466-1907f352d48a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:28:39 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-9e45c319-8a3b-4641-9915-69b2c9522677 req-eea834f3-b17d-4718-9466-1907f352d48a service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:28:39 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-9e45c319-8a3b-4641-9915-69b2c9522677 req-eea834f3-b17d-4718-9466-1907f352d48a service nova] Creating event network-vif-plugged:a8cfeb44-bde7-4cc3-b957-c8db3f7fb3de for instance 5d60a364-b914-4d2c-8fcc-5944148dcecf on user Apr 24 00:28:39 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-9e45c319-8a3b-4641-9915-69b2c9522677 req-eea834f3-b17d-4718-9466-1907f352d48a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028200 Apr 24 00:28:39 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 146/426] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] [instance: 5d60a364-b914-4d2c-8fcc-5944148dcecf] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:29:27 user devstack@n-api.service[61493]: INFO nova.api.openstack.wsgi [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] HTTP exception thrown: Instance 5d60a364-b914-4d2c-8fcc-5944148dcecf could not be found. Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Request method failure captured: Apr 24 00:29:27 user devstack@n-api.service[61493]: request: GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf HTTP/1.1 Apr 24 00:29:27 user devstack@n-api.service[61493]: Accept: application/json Apr 24 00:29:27 user devstack@n-api.service[61493]: Accept-Encoding: identity Apr 24 00:29:27 user devstack@n-api.service[61493]: Connection: close Apr 24 00:29:27 user devstack@n-api.service[61493]: Content-Length: 0 Apr 24 00:29:27 user devstack@n-api.service[61493]: Content-Type: application/json Apr 24 00:29:27 user devstack@n-api.service[61493]: Host: 10.0.0.210 Apr 24 00:29:27 user devstack@n-api.service[61493]: Openstack-System-Scope: None Apr 24 00:29:27 user devstack@n-api.service[61493]: User-Agent: python-urllib3/1.26.15 Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Auth-Token: gAAAAABkRcxQ8OWlKr1uuwE4WUcbbQToph4rMBirHe8Ww00k1byjTYyR-u7vNNsLz28FbLcOs0mbhjmebyScRWQ_bn81CFfQ-RqaheK8dhvqckFloUJ8NzBrLKWEGT2_4sKJk7B9L8Z03fHiFD9xp0I58i6YkErRkjxOJnKZqTf10M8j6k0xHPs Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Domain-Id: None Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Domain-Name: None Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Identity-Status: Confirmed Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Is-Admin-Project: True Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Project-Domain-Id: default Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Project-Domain-Name: Default Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Project-Id: ffcdb2ab0e4145ad988f91b13ebd629e Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1726718806 Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Role: reader,member Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Roles: reader,member Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ffcdb2ab0e4145ad988f91b13ebd629e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ffcdb2ab0e4145ad988f91b13ebd629e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ffcdb2ab0e4145ad988f91b13ebd629e"}]}] Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Tenant: tempest-ServerStableDeviceRescueTest-1726718806 Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Tenant-Id: ffcdb2ab0e4145ad988f91b13ebd629e Apr 24 00:29:27 user devstack@n-api.service[61493]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1726718806 Apr 24 00:29:27 user devstack@n-api.service[61493]: X-User: tempest-ServerStableDeviceRescueTest-1726718806-project-member Apr 24 00:29:27 user devstack@n-api.service[61493]: X-User-Domain-Id: default Apr 24 00:29:27 user devstack@n-api.service[61493]: X-User-Domain-Name: Default Apr 24 00:29:27 user devstack@n-api.service[61493]: X-User-Id: 61677897acda43ca83dd2c702e6e5eb5 Apr 24 00:29:27 user devstack@n-api.service[61493]: X-User-Name: tempest-ServerStableDeviceRescueTest-1726718806-project-member Apr 24 00:29:27 user devstack@n-api.service[61493]: method: > Apr 24 00:29:27 user devstack@n-api.service[61493]: exception: Instance 5d60a364-b914-4d2c-8fcc-5944148dcecf could not be found. Apr 24 00:29:27 user devstack@n-api.service[61493]: action_args: {'id': '5d60a364-b914-4d2c-8fcc-5944148dcecf'} Apr 24 00:29:27 user devstack@n-api.service[61493]: {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d60a364-b914-4d2c-8fcc-5944148dcecf could not be found. Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d60a364-b914-4d2c-8fcc-5944148dcecf could not be found. Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d60a364-b914-4d2c-8fcc-5944148dcecf could not be found. Apr 24 00:29:27 user devstack@n-api.service[61493]: ERROR nova.api.openstack.wsgi Apr 24 00:29:27 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Returning 404 to user: Instance 5d60a364-b914-4d2c-8fcc-5944148dcecf could not be found. {{(pid=61493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:29:27 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-593b14a6-b039-4539-bac7-508715ec6e8e tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf" status: 404 len: 111 microversion: 2.1 time: 0.038423 Apr 24 00:29:27 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 142/427] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:29:27 2023] GET /compute/v2.1/servers/5d60a364-b914-4d2c-8fcc-5944148dcecf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 24 00:29:27 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:29:27 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:29:27 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-49542e02-6d20-457c-94fd-ce747865e5af tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] Calling method '.version_select at 0x7fc8c3766830>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:29:27 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-49542e02-6d20-457c-94fd-ce747865e5af tempest-ServerStableDeviceRescueTest-1726718806 tempest-ServerStableDeviceRescueTest-1726718806-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862289859" status: 202 len: 0 microversion: 2.1 time: 0.037596 Apr 24 00:29:27 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 140/428] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 24 00:29:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862289859 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:30:00 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:00 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=14 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:00 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-0bc209c0-8964-4d8d-9d83-c98d277d7017 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Action: 'create', calling method: .version_select at 0x7fc8c362ba30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1846912878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLDJJcBY83bYII2cz2UBFOs5JtscigjyJMQ6jSr5Zo8Gh64wLUW7PYGf39MocYkX0cAAMut0zrK8qkD0z8MC1LDRzLMpevf5gaOOpR4zhAODKbduqMVR4FvaWE7tF8Jag=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:30:00 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-0bc209c0-8964-4d8d-9d83-c98d277d7017 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:30:00 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-0bc209c0-8964-4d8d-9d83-c98d277d7017 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for user e2ca48cbf8204d958685eaa42f6b6952 and project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:30:00 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-0bc209c0-8964-4d8d-9d83-c98d277d7017 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.069726 Apr 24 00:30:00 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 147/429] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:30:00 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:30:00 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1216480377", "imageRef": "9ecdd39b-39aa-4c6d-a449-0f574c554082", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1846912878", "networks": [{"uuid": "bbd390a3-499e-4b86-9c48-401b14864b06"}]}} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:30:00 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:00 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:00 user devstack@n-api.service[61493]: DEBUG nova.network.neutron [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] validate_networks() for [('bbd390a3-499e-4b86-9c48-401b14864b06', None, None, None, None, None)] {{(pid=61493) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Flavor limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Image limits 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Flavor pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Image pref 0:0:0 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.virt.hardware [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.quota [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for user e2ca48cbf8204d958685eaa42f6b6952 and project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=61493) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Going to run 1 instances... {{(pid=61493) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:30:01 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9ecdd39b-39aa-4c6d-a449-0f574c554082',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:30:01 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-3ee209ee-5f76-49db-b046-e317978963b2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.734502 Apr 24 00:30:01 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 143/430] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:30:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:30:01 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-4d0308d9-900a-41fb-8f8f-c780d8b59de2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:30:01 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-4d0308d9-900a-41fb-8f8f-c780d8b59de2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:30:01 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:01 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-4d0308d9-900a-41fb-8f8f-c780d8b59de2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:30:01 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-4d0308d9-900a-41fb-8f8f-c780d8b59de2 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 200 len: 1253 microversion: 2.1 time: 0.073352 Apr 24 00:30:01 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 141/431] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:30:01 2023] GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 1253 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:30:03 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-e3bd7387-c8bd-4f5c-ac0a-3d131eb7fa5f req-cafc8e91-16d0-4a26-b416-fa6d6215f28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3441ea8c-1b7f-4db7-b26a-37c56edc2453", "tag": "cd924951-296b-43e1-b7d6-c7769ba90ee7"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:30:03 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e3bd7387-c8bd-4f5c-ac0a-3d131eb7fa5f req-cafc8e91-16d0-4a26-b416-fa6d6215f28d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:03 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e3bd7387-c8bd-4f5c-ac0a-3d131eb7fa5f req-cafc8e91-16d0-4a26-b416-fa6d6215f28d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:03 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-e3bd7387-c8bd-4f5c-ac0a-3d131eb7fa5f req-cafc8e91-16d0-4a26-b416-fa6d6215f28d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:03 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-e3bd7387-c8bd-4f5c-ac0a-3d131eb7fa5f req-cafc8e91-16d0-4a26-b416-fa6d6215f28d service nova] Creating event network-changed:cd924951-296b-43e1-b7d6-c7769ba90ee7 for instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 on user Apr 24 00:30:03 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-e3bd7387-c8bd-4f5c-ac0a-3d131eb7fa5f req-cafc8e91-16d0-4a26-b416-fa6d6215f28d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159472 Apr 24 00:30:03 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 148/432] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:30:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:30:05 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-3624562e-6bdf-4eca-b320-abbb232f5565 req-97bfd309-65a0-470c-8abb-3a7bcb8d63e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441ea8c-1b7f-4db7-b26a-37c56edc2453", "name": "network-vif-plugged", "status": "completed", "tag": "cd924951-296b-43e1-b7d6-c7769ba90ee7"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:30:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3624562e-6bdf-4eca-b320-abbb232f5565 req-97bfd309-65a0-470c-8abb-3a7bcb8d63e2 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3624562e-6bdf-4eca-b320-abbb232f5565 req-97bfd309-65a0-470c-8abb-3a7bcb8d63e2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:05 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3624562e-6bdf-4eca-b320-abbb232f5565 req-97bfd309-65a0-470c-8abb-3a7bcb8d63e2 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-3624562e-6bdf-4eca-b320-abbb232f5565 req-97bfd309-65a0-470c-8abb-3a7bcb8d63e2 service nova] Creating event network-vif-plugged:cd924951-296b-43e1-b7d6-c7769ba90ee7 for instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 on user Apr 24 00:30:05 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-3624562e-6bdf-4eca-b320-abbb232f5565 req-97bfd309-65a0-470c-8abb-3a7bcb8d63e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139902 Apr 24 00:30:05 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 144/433] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:30:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:30:08 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-d124a9cf-a0a7-4b57-8673-a6c0a881b5ad req-5724ebf9-3590-4c98-b892-c0feff7cb2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441ea8c-1b7f-4db7-b26a-37c56edc2453", "name": "network-vif-plugged", "status": "completed", "tag": "cd924951-296b-43e1-b7d6-c7769ba90ee7"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:30:08 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-d124a9cf-a0a7-4b57-8673-a6c0a881b5ad req-5724ebf9-3590-4c98-b892-c0feff7cb2c9 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:08 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-d124a9cf-a0a7-4b57-8673-a6c0a881b5ad req-5724ebf9-3590-4c98-b892-c0feff7cb2c9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:08 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-d124a9cf-a0a7-4b57-8673-a6c0a881b5ad req-5724ebf9-3590-4c98-b892-c0feff7cb2c9 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:08 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-d124a9cf-a0a7-4b57-8673-a6c0a881b5ad req-5724ebf9-3590-4c98-b892-c0feff7cb2c9 service nova] Creating event network-vif-plugged:cd924951-296b-43e1-b7d6-c7769ba90ee7 for instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 on user Apr 24 00:30:08 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-d124a9cf-a0a7-4b57-8673-a6c0a881b5ad req-5724ebf9-3590-4c98-b892-c0feff7cb2c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Apr 24 00:30:08 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 142/434] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:30:51 user devstack@n-api.service[61492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 24 00:30:51 user devstack@n-api.service[61492]: Mon Apr 24 00:30:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 (ip 10.0.0.210) !!! Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:30:51 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:30:51 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-85befeff-fe53-424f-a4e9-d77fa727596d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 200 len: 1537 microversion: 2.1 time: 0.253447 Apr 24 00:30:51 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 149/435] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:30:51 2023] GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=6 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:51 user devstack@n-api.service[61493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 24 00:31:51 user devstack@n-api.service[61493]: Mon Apr 24 00:31:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 (ip 10.0.0.210) !!! Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=4 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:51 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:31:51 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-93aa3b10-1702-4dd8-b604-eb3537a1ec19 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 200 len: 1537 microversion: 2.1 time: 0.376591 Apr 24 00:31:51 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 145/436] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:31:51 2023] GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 1537 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:31:51 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:51 user devstack@n-api.service[61491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 24 00:31:51 user devstack@n-api.service[61491]: Mon Apr 24 00:31:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 24 00:31:51 user devstack@n-api.service[61491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 24 00:31:51 user devstack@n-api.service[61491]: Mon Apr 24 00:31:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 24 00:31:51 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:51 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Searching by: {'deleted': False, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2'} {{(pid=61491) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:52 user devstack@n-api.service[61491]: DEBUG nova.compute.multi_cell_list [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 24 00:31:52 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-2ad38288-508e-40af-9e2a-e1795bec9e55 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.210324 Apr 24 00:31:52 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 143/437] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Apr 24 00:31:51 2023] GET /compute/v2.1/servers => generated 341 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:52 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:31:52 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-ca84a52f-e170-4f25-8013-1212c66f3e6d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 200 len: 1537 microversion: 2.1 time: 0.200818 Apr 24 00:31:52 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 150/438] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:31:52 2023] GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:53 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Going to try to terminate instance {{(pid=61493) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:31:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-9ee08598-c5dc-4728-b10b-bb5f52187677 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 204 len: 0 microversion: 2.1 time: 0.116836 Apr 24 00:31:54 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 146/439] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:31:53 2023] DELETE /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:54 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-6eba3bd7-6297-4c52-b8c0-432ef46222a7 req-100c2ee2-3614-4640-8e57-cb30d41a840e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441ea8c-1b7f-4db7-b26a-37c56edc2453", "name": "network-vif-unplugged", "status": "completed", "tag": "cd924951-296b-43e1-b7d6-c7769ba90ee7"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:31:54 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-6eba3bd7-6297-4c52-b8c0-432ef46222a7 req-100c2ee2-3614-4640-8e57-cb30d41a840e service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:54 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-6eba3bd7-6297-4c52-b8c0-432ef46222a7 req-100c2ee2-3614-4640-8e57-cb30d41a840e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:54 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-6eba3bd7-6297-4c52-b8c0-432ef46222a7 req-100c2ee2-3614-4640-8e57-cb30d41a840e service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:54 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-6eba3bd7-6297-4c52-b8c0-432ef46222a7 req-100c2ee2-3614-4640-8e57-cb30d41a840e service nova] Creating event network-vif-unplugged:cd924951-296b-43e1-b7d6-c7769ba90ee7 for instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 on user Apr 24 00:31:54 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-6eba3bd7-6297-4c52-b8c0-432ef46222a7 req-100c2ee2-3614-4640-8e57-cb30d41a840e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031887 Apr 24 00:31:54 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 151/440] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:31:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:31:54 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:31:54 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-7e1c3617-d7f7-4df1-b7c5-0f98d35f6ddc tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 200 len: 1543 microversion: 2.1 time: 0.337803 Apr 24 00:31:54 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 144/441] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:31:54 2023] GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 1543 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:31:55 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-3dc684c5-fa0c-4907-b2b2-aff8be2bffe9 req-d60b185c-82c2-4b6e-be49-7270865b6e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441ea8c-1b7f-4db7-b26a-37c56edc2453", "name": "network-vif-deleted", "tag": "cd924951-296b-43e1-b7d6-c7769ba90ee7"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:31:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3dc684c5-fa0c-4907-b2b2-aff8be2bffe9 req-d60b185c-82c2-4b6e-be49-7270865b6e82 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3dc684c5-fa0c-4907-b2b2-aff8be2bffe9 req-d60b185c-82c2-4b6e-be49-7270865b6e82 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:55 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-3dc684c5-fa0c-4907-b2b2-aff8be2bffe9 req-d60b185c-82c2-4b6e-be49-7270865b6e82 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-3dc684c5-fa0c-4907-b2b2-aff8be2bffe9 req-d60b185c-82c2-4b6e-be49-7270865b6e82 service nova] Creating event network-vif-deleted:cd924951-296b-43e1-b7d6-c7769ba90ee7 for instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 on user Apr 24 00:31:55 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-3dc684c5-fa0c-4907-b2b2-aff8be2bffe9 req-d60b185c-82c2-4b6e-be49-7270865b6e82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030326 Apr 24 00:31:55 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:31:56 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-a13cbadf-17d7-4c70-80de-832eb5fb0d16 req-bd94e17d-4a0d-4a1b-89f5-0b0761588e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3441ea8c-1b7f-4db7-b26a-37c56edc2453", "name": "network-vif-plugged", "status": "completed", "tag": "cd924951-296b-43e1-b7d6-c7769ba90ee7"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:31:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a13cbadf-17d7-4c70-80de-832eb5fb0d16 req-bd94e17d-4a0d-4a1b-89f5-0b0761588e1f service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:31:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a13cbadf-17d7-4c70-80de-832eb5fb0d16 req-bd94e17d-4a0d-4a1b-89f5-0b0761588e1f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:31:56 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-a13cbadf-17d7-4c70-80de-832eb5fb0d16 req-bd94e17d-4a0d-4a1b-89f5-0b0761588e1f service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:31:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-a13cbadf-17d7-4c70-80de-832eb5fb0d16 req-bd94e17d-4a0d-4a1b-89f5-0b0761588e1f service nova] Creating event network-vif-plugged:cd924951-296b-43e1-b7d6-c7769ba90ee7 for instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 on user Apr 24 00:31:56 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-a13cbadf-17d7-4c70-80de-832eb5fb0d16 req-bd94e17d-4a0d-4a1b-89f5-0b0761588e1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030508 Apr 24 00:31:56 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 152/443] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:31:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: 3441ea8c-1b7f-4db7-b26a-37c56edc2453] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=4 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=14 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:44 user devstack@n-api.service[61491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 24 00:32:44 user devstack@n-api.service[61491]: Mon Apr 24 00:32:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 (ip 10.0.0.210) !!! Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:44 user devstack@n-api.service[61491]: INFO nova.api.openstack.wsgi [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] HTTP exception thrown: Instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 could not be found. Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Request method failure captured: Apr 24 00:32:44 user devstack@n-api.service[61491]: request: GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 HTTP/1.1 Apr 24 00:32:44 user devstack@n-api.service[61491]: Accept: application/json Apr 24 00:32:44 user devstack@n-api.service[61491]: Accept-Encoding: identity Apr 24 00:32:44 user devstack@n-api.service[61491]: Connection: close Apr 24 00:32:44 user devstack@n-api.service[61491]: Content-Length: 0 Apr 24 00:32:44 user devstack@n-api.service[61491]: Content-Type: application/json Apr 24 00:32:44 user devstack@n-api.service[61491]: Host: 10.0.0.210 Apr 24 00:32:44 user devstack@n-api.service[61491]: Openstack-System-Scope: None Apr 24 00:32:44 user devstack@n-api.service[61491]: User-Agent: python-urllib3/1.26.15 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Auth-Token: gAAAAABkRc1_q9xHuUfo0tt1G6YPT4MqShwDrLypdtiClgaV5a_u44_gt9wiUZ18j5Lxf1nKgWk9DtUwSRUSEZo1mhRmekrGjhiaZOoSAgGHGsvdJYWBeBZ6xvXI8uqgBwUfEsdOQ0MQeO8MhSlxMpSUtWocKqDbccnL8prm_c32x603cHutsCQ Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Domain-Id: None Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Domain-Name: None Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Identity-Status: Confirmed Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Is-Admin-Project: True Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Project-Domain-Id: default Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Project-Domain-Name: Default Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Project-Id: c607157092ca4b0ea2d01c6fe7fb18c2 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Project-Name: tempest-TestMinimumBasicScenario-776289633 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Role: reader,member Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Roles: reader,member Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c607157092ca4b0ea2d01c6fe7fb18c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c607157092ca4b0ea2d01c6fe7fb18c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c607157092ca4b0ea2d01c6fe7fb18c2"}]}] Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Tenant: tempest-TestMinimumBasicScenario-776289633 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Tenant-Id: c607157092ca4b0ea2d01c6fe7fb18c2 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-Tenant-Name: tempest-TestMinimumBasicScenario-776289633 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-User: tempest-TestMinimumBasicScenario-776289633-project-member Apr 24 00:32:44 user devstack@n-api.service[61491]: X-User-Domain-Id: default Apr 24 00:32:44 user devstack@n-api.service[61491]: X-User-Domain-Name: Default Apr 24 00:32:44 user devstack@n-api.service[61491]: X-User-Id: e2ca48cbf8204d958685eaa42f6b6952 Apr 24 00:32:44 user devstack@n-api.service[61491]: X-User-Name: tempest-TestMinimumBasicScenario-776289633-project-member Apr 24 00:32:44 user devstack@n-api.service[61491]: method: > Apr 24 00:32:44 user devstack@n-api.service[61491]: exception: Instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 could not be found. Apr 24 00:32:44 user devstack@n-api.service[61491]: action_args: {'id': '3441ea8c-1b7f-4db7-b26a-37c56edc2453'} Apr 24 00:32:44 user devstack@n-api.service[61491]: {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 could not be found. Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 could not be found. Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 could not be found. Apr 24 00:32:44 user devstack@n-api.service[61491]: ERROR nova.api.openstack.wsgi Apr 24 00:32:44 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Returning 404 to user: Instance 3441ea8c-1b7f-4db7-b26a-37c56edc2453 could not be found. {{(pid=61491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:32:44 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-c74bdd1c-49d5-4d8d-8007-d63bae3a2c39 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453" status: 404 len: 111 microversion: 2.1 time: 0.048087 Apr 24 00:32:44 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 145/444] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:32:44 2023] GET /compute/v2.1/servers/3441ea8c-1b7f-4db7-b26a-37c56edc2453 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:32:44 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:44 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:44 user devstack@n-api.service[61493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 24 00:32:44 user devstack@n-api.service[61493]: Mon Apr 24 00:32:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1846912878 (ip 10.0.0.210) !!! Apr 24 00:32:44 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-64976099-b92d-461a-af41-6bb87eab9466 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '.version_select at 0x7fc8c38afe20>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:32:44 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-64976099-b92d-461a-af41-6bb87eab9466 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1846912878" status: 202 len: 0 microversion: 2.1 time: 0.042176 Apr 24 00:32:44 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1349 bytes} [Mon Apr 24 00:32:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1846912878 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 24 00:32:46 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:46 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=10 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:32:46 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-56e18fc9-7a21-4c28-89f1-89decb1f34a3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Action: 'create', calling method: .version_select at 0x7fc8c3629a20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-571855735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/yBQ3OeQ6p3JWTMHIDZTKaDI1rEfdHuupYSVs84i1LbT47YEJ6RDAi4BJ9tHinujF4UyeJuVsDtyFCcsUXegAo8xzzOvG1iF59HUjKwHaDr5EsL0PxFO1OUkiouNZxPA=="}} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:32:46 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-56e18fc9-7a21-4c28-89f1-89decb1f34a3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:32:46 user devstack@n-api.service[61492]: DEBUG nova.quota [None req-56e18fc9-7a21-4c28-89f1-89decb1f34a3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for user e2ca48cbf8204d958685eaa42f6b6952 and project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'key_pairs'} {{(pid=61492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:32:46 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-56e18fc9-7a21-4c28-89f1-89decb1f34a3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054944 Apr 24 00:32:46 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 153/446] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 24 00:32:46 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:32:46 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1411545761", "imageRef": "fa4c3529-43a6-4316-88b2-b3bbed76c1f7", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-571855735", "networks": [{"uuid": "bbd390a3-499e-4b86-9c48-401b14864b06"}]}} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:32:46 user devstack@n-api.service[61491]: DEBUG nova.network.neutron [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] validate_networks() for [('bbd390a3-499e-4b86-9c48-401b14864b06', None, None, None, None, None)] {{(pid=61491) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Flavor limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Image limits 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Flavor pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Image pref 0:0:0 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.virt.hardware [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.quota [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Getting quotas for user e2ca48cbf8204d958685eaa42f6b6952 and project c607157092ca4b0ea2d01c6fe7fb18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=61491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Going to run 1 instances... {{(pid=61491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 24 00:32:47 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa4c3529-43a6-4316-88b2-b3bbed76c1f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 24 00:32:47 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-9be327b3-3aae-443a-ac0a-82906860f34c tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.739990 Apr 24 00:32:47 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 146/447] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 24 00:32:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 24 00:32:47 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-c2e19385-860e-4616-aea9-389a0c9f49d3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:32:47 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-c2e19385-860e-4616-aea9-389a0c9f49d3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:32:47 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-c2e19385-860e-4616-aea9-389a0c9f49d3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:32:47 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-c2e19385-860e-4616-aea9-389a0c9f49d3 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 200 len: 1252 microversion: 2.1 time: 0.067685 Apr 24 00:32:47 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:32:47 2023] GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 1252 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:32:50 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-4c72b616-234c-4600-83db-e2cec3fb907e req-621709ea-3710-4819-a095-252c357d8bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b330e0bf-027f-4d61-ba28-93465a74b370", "tag": "c8d80bab-94ba-4cad-aa6e-ff776b596163"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:32:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-4c72b616-234c-4600-83db-e2cec3fb907e req-621709ea-3710-4819-a095-252c357d8bc6 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-4c72b616-234c-4600-83db-e2cec3fb907e req-621709ea-3710-4819-a095-252c357d8bc6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:50 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-4c72b616-234c-4600-83db-e2cec3fb907e req-621709ea-3710-4819-a095-252c357d8bc6 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:50 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-4c72b616-234c-4600-83db-e2cec3fb907e req-621709ea-3710-4819-a095-252c357d8bc6 service nova] Creating event network-changed:c8d80bab-94ba-4cad-aa6e-ff776b596163 for instance b330e0bf-027f-4d61-ba28-93465a74b370 on user Apr 24 00:32:50 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-4c72b616-234c-4600-83db-e2cec3fb907e req-621709ea-3710-4819-a095-252c357d8bc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029710 Apr 24 00:32:50 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 154/449] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:32:52 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-50eefd25-86a2-44a6-902b-c473d894b2cd req-05090fa2-52ad-4632-9e59-49785ac0ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330e0bf-027f-4d61-ba28-93465a74b370", "name": "network-vif-plugged", "status": "completed", "tag": "c8d80bab-94ba-4cad-aa6e-ff776b596163"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:32:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-50eefd25-86a2-44a6-902b-c473d894b2cd req-05090fa2-52ad-4632-9e59-49785ac0ac14 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-50eefd25-86a2-44a6-902b-c473d894b2cd req-05090fa2-52ad-4632-9e59-49785ac0ac14 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:52 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-50eefd25-86a2-44a6-902b-c473d894b2cd req-05090fa2-52ad-4632-9e59-49785ac0ac14 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:52 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-50eefd25-86a2-44a6-902b-c473d894b2cd req-05090fa2-52ad-4632-9e59-49785ac0ac14 service nova] Creating event network-vif-plugged:c8d80bab-94ba-4cad-aa6e-ff776b596163 for instance b330e0bf-027f-4d61-ba28-93465a74b370 on user Apr 24 00:32:52 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-50eefd25-86a2-44a6-902b-c473d894b2cd req-05090fa2-52ad-4632-9e59-49785ac0ac14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Apr 24 00:32:52 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 147/450] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:32:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:32:54 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-633b30c5-2de4-4db6-afab-28d5906f97f6 req-c4cfc98c-56b6-4718-971e-5224a7f9f96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330e0bf-027f-4d61-ba28-93465a74b370", "name": "network-vif-plugged", "status": "completed", "tag": "c8d80bab-94ba-4cad-aa6e-ff776b596163"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:32:54 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-633b30c5-2de4-4db6-afab-28d5906f97f6 req-c4cfc98c-56b6-4718-971e-5224a7f9f96d service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:32:54 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-633b30c5-2de4-4db6-afab-28d5906f97f6 req-c4cfc98c-56b6-4718-971e-5224a7f9f96d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:32:54 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-633b30c5-2de4-4db6-afab-28d5906f97f6 req-c4cfc98c-56b6-4718-971e-5224a7f9f96d service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:32:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-633b30c5-2de4-4db6-afab-28d5906f97f6 req-c4cfc98c-56b6-4718-971e-5224a7f9f96d service nova] Creating event network-vif-plugged:c8d80bab-94ba-4cad-aa6e-ff776b596163 for instance b330e0bf-027f-4d61-ba28-93465a74b370 on user Apr 24 00:32:54 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-633b30c5-2de4-4db6-afab-28d5906f97f6 req-c4cfc98c-56b6-4718-971e-5224a7f9f96d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Apr 24 00:32:54 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 150/451] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:32:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell0:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:33:37 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:33:38 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:33:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-8fae704c-7918-408b-b216-288c8fa61d16 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 200 len: 1536 microversion: 2.1 time: 0.324773 Apr 24 00:33:38 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 155/452] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:33:37 2023] GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 1536 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=2 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell0:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=6 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:38 user devstack@n-api.service[61491]: DEBUG nova.policy [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61491) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:34:38 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-cbb2db9d-b6ee-4aab-83dc-f3492e90ef2d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 200 len: 1536 microversion: 2.1 time: 0.246872 Apr 24 00:34:38 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 148/453] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:34:38 2023] GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 1536 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell0:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG dbcounter [-] [61493] Writing DB stats nova_cell1:SELECT=2 {{(pid=61493) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Searching by: {'deleted': False, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2'} {{(pid=61493) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:38 user devstack@n-api.service[61493]: DEBUG nova.compute.multi_cell_list [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61493) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 24 00:34:38 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-055811bb-1ead-4dab-86d6-66e6a32b09db tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.254774 Apr 24 00:34:38 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 151/454] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Apr 24 00:34:38 2023] GET /compute/v2.1/servers => generated 341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=2 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=6 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:38 user devstack@n-api.service[61492]: DEBUG nova.policy [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61492) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:34:38 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-f13c198b-28cd-4f84-a666-6374b750f51d tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 200 len: 1536 microversion: 2.1 time: 0.239546 Apr 24 00:34:38 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 156/455] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:34:38 2023] GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 1536 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61491) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:40 user devstack@n-api.service[61491]: DEBUG nova.compute.api [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Going to try to terminate instance {{(pid=61491) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 24 00:34:40 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-91e2e752-1f1b-4eaa-840b-935c0ab25652 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 204 len: 0 microversion: 2.1 time: 0.111003 Apr 24 00:34:40 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 149/456] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 24 00:34:40 2023] DELETE /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG nova.compute.api [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61493) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:40 user devstack@n-api.service[61493]: DEBUG nova.policy [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ca48cbf8204d958685eaa42f6b6952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c607157092ca4b0ea2d01c6fe7fb18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61493) authorize /opt/stack/nova/nova/policy.py:203}} Apr 24 00:34:40 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [None req-2953da51-b7cc-4a5b-8e23-ad8eb209fd0f tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 200 len: 1542 microversion: 2.1 time: 0.187234 Apr 24 00:34:40 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:34:40 2023] GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 24 00:34:40 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [req-c6fe540a-ab54-41d6-a0d8-09e7e95d8418 req-c41a0e0e-c5df-4163-a9d9-2dd0d287af85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330e0bf-027f-4d61-ba28-93465a74b370", "name": "network-vif-unplugged", "status": "completed", "tag": "c8d80bab-94ba-4cad-aa6e-ff776b596163"}]} {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:34:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c6fe540a-ab54-41d6-a0d8-09e7e95d8418 req-c41a0e0e-c5df-4163-a9d9-2dd0d287af85 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c6fe540a-ab54-41d6-a0d8-09e7e95d8418 req-c41a0e0e-c5df-4163-a9d9-2dd0d287af85 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:40 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [req-c6fe540a-ab54-41d6-a0d8-09e7e95d8418 req-c41a0e0e-c5df-4163-a9d9-2dd0d287af85 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:40 user devstack@n-api.service[61492]: INFO nova.api.openstack.compute.server_external_events [req-c6fe540a-ab54-41d6-a0d8-09e7e95d8418 req-c41a0e0e-c5df-4163-a9d9-2dd0d287af85 service nova] Creating event network-vif-unplugged:c8d80bab-94ba-4cad-aa6e-ff776b596163 for instance b330e0bf-027f-4d61-ba28-93465a74b370 on user Apr 24 00:34:40 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [req-c6fe540a-ab54-41d6-a0d8-09e7e95d8418 req-c41a0e0e-c5df-4163-a9d9-2dd0d287af85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124451 Apr 24 00:34:40 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 157/458] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:34:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:34:41 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [req-9684334b-d412-4973-b381-e94bf76e92a3 req-7e2379c1-a228-4f57-91db-574fbe9d7b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330e0bf-027f-4d61-ba28-93465a74b370", "name": "network-vif-deleted", "tag": "c8d80bab-94ba-4cad-aa6e-ff776b596163"}]} {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:34:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-9684334b-d412-4973-b381-e94bf76e92a3 req-7e2379c1-a228-4f57-91db-574fbe9d7b01 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-9684334b-d412-4973-b381-e94bf76e92a3 req-7e2379c1-a228-4f57-91db-574fbe9d7b01 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:41 user devstack@n-api.service[61491]: DEBUG oslo_concurrency.lockutils [req-9684334b-d412-4973-b381-e94bf76e92a3 req-7e2379c1-a228-4f57-91db-574fbe9d7b01 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:41 user devstack@n-api.service[61491]: INFO nova.api.openstack.compute.server_external_events [req-9684334b-d412-4973-b381-e94bf76e92a3 req-7e2379c1-a228-4f57-91db-574fbe9d7b01 service nova] Creating event network-vif-deleted:c8d80bab-94ba-4cad-aa6e-ff776b596163 for instance b330e0bf-027f-4d61-ba28-93465a74b370 on user Apr 24 00:34:41 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [req-9684334b-d412-4973-b381-e94bf76e92a3 req-7e2379c1-a228-4f57-91db-574fbe9d7b01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031088 Apr 24 00:34:41 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 150/459] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 24 00:34:42 user devstack@n-api.service[61493]: DEBUG nova.api.openstack.wsgi [req-932939e0-0e9e-4e1d-bb51-47493ae7dce7 req-2a4ed8a6-5a60-4fef-ae23-613ddff7d5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b330e0bf-027f-4d61-ba28-93465a74b370", "name": "network-vif-plugged", "status": "completed", "tag": "c8d80bab-94ba-4cad-aa6e-ff776b596163"}]} {{(pid=61493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 24 00:34:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-932939e0-0e9e-4e1d-bb51-47493ae7dce7 req-2a4ed8a6-5a60-4fef-ae23-613ddff7d5b0 service nova] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:34:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-932939e0-0e9e-4e1d-bb51-47493ae7dce7 req-2a4ed8a6-5a60-4fef-ae23-613ddff7d5b0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:34:42 user devstack@n-api.service[61493]: DEBUG oslo_concurrency.lockutils [req-932939e0-0e9e-4e1d-bb51-47493ae7dce7 req-2a4ed8a6-5a60-4fef-ae23-613ddff7d5b0 service nova] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61493) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:34:42 user devstack@n-api.service[61493]: INFO nova.api.openstack.compute.server_external_events [req-932939e0-0e9e-4e1d-bb51-47493ae7dce7 req-2a4ed8a6-5a60-4fef-ae23-613ddff7d5b0 service nova] Creating event network-vif-plugged:c8d80bab-94ba-4cad-aa6e-ff776b596163 for instance b330e0bf-027f-4d61-ba28-93465a74b370 on user Apr 24 00:34:42 user devstack@n-api.service[61493]: INFO nova.api.openstack.requestlog [req-932939e0-0e9e-4e1d-bb51-47493ae7dce7 req-2a4ed8a6-5a60-4fef-ae23-613ddff7d5b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Apr 24 00:34:42 user devstack@n-api.service[61493]: [pid: 61493|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 24 00:34:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_api:SELECT=4 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG dbcounter [-] [61492] Writing DB stats nova_cell1:SELECT=8 {{(pid=61492) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '>' {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG nova.compute.api [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] [instance: b330e0bf-027f-4d61-ba28-93465a74b370] Fetching instance by UUID {{(pid=61492) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Acquiring lock "a345e55a-e119-441a-a250-b58384b04676" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG oslo_concurrency.lockutils [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Lock "a345e55a-e119-441a-a250-b58384b04676" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61492) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 24 00:35:30 user devstack@n-api.service[61492]: INFO nova.api.openstack.wsgi [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] HTTP exception thrown: Instance b330e0bf-027f-4d61-ba28-93465a74b370 could not be found. Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Request method failure captured: Apr 24 00:35:30 user devstack@n-api.service[61492]: request: GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 HTTP/1.1 Apr 24 00:35:30 user devstack@n-api.service[61492]: Accept: application/json Apr 24 00:35:30 user devstack@n-api.service[61492]: Accept-Encoding: identity Apr 24 00:35:30 user devstack@n-api.service[61492]: Connection: close Apr 24 00:35:30 user devstack@n-api.service[61492]: Content-Length: 0 Apr 24 00:35:30 user devstack@n-api.service[61492]: Content-Type: application/json Apr 24 00:35:30 user devstack@n-api.service[61492]: Host: 10.0.0.210 Apr 24 00:35:30 user devstack@n-api.service[61492]: Openstack-System-Scope: None Apr 24 00:35:30 user devstack@n-api.service[61492]: User-Agent: python-urllib3/1.26.15 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Auth-Token: gAAAAABkRc1_q9xHuUfo0tt1G6YPT4MqShwDrLypdtiClgaV5a_u44_gt9wiUZ18j5Lxf1nKgWk9DtUwSRUSEZo1mhRmekrGjhiaZOoSAgGHGsvdJYWBeBZ6xvXI8uqgBwUfEsdOQ0MQeO8MhSlxMpSUtWocKqDbccnL8prm_c32x603cHutsCQ Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Domain-Id: None Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Domain-Name: None Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Identity-Status: Confirmed Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Is-Admin-Project: True Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Project-Domain-Id: default Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Project-Domain-Name: Default Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Project-Id: c607157092ca4b0ea2d01c6fe7fb18c2 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Project-Name: tempest-TestMinimumBasicScenario-776289633 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Role: reader,member Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Roles: reader,member Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c607157092ca4b0ea2d01c6fe7fb18c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c607157092ca4b0ea2d01c6fe7fb18c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c607157092ca4b0ea2d01c6fe7fb18c2"}]}] Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Tenant: tempest-TestMinimumBasicScenario-776289633 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Tenant-Id: c607157092ca4b0ea2d01c6fe7fb18c2 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-Tenant-Name: tempest-TestMinimumBasicScenario-776289633 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-User: tempest-TestMinimumBasicScenario-776289633-project-member Apr 24 00:35:30 user devstack@n-api.service[61492]: X-User-Domain-Id: default Apr 24 00:35:30 user devstack@n-api.service[61492]: X-User-Domain-Name: Default Apr 24 00:35:30 user devstack@n-api.service[61492]: X-User-Id: e2ca48cbf8204d958685eaa42f6b6952 Apr 24 00:35:30 user devstack@n-api.service[61492]: X-User-Name: tempest-TestMinimumBasicScenario-776289633-project-member Apr 24 00:35:30 user devstack@n-api.service[61492]: method: > Apr 24 00:35:30 user devstack@n-api.service[61492]: exception: Instance b330e0bf-027f-4d61-ba28-93465a74b370 could not be found. Apr 24 00:35:30 user devstack@n-api.service[61492]: action_args: {'id': 'b330e0bf-027f-4d61-ba28-93465a74b370'} Apr 24 00:35:30 user devstack@n-api.service[61492]: {{(pid=61492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b330e0bf-027f-4d61-ba28-93465a74b370 could not be found. Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b330e0bf-027f-4d61-ba28-93465a74b370 could not be found. Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b330e0bf-027f-4d61-ba28-93465a74b370 could not be found. Apr 24 00:35:30 user devstack@n-api.service[61492]: ERROR nova.api.openstack.wsgi Apr 24 00:35:30 user devstack@n-api.service[61492]: DEBUG nova.api.openstack.wsgi [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Returning 404 to user: Instance b330e0bf-027f-4d61-ba28-93465a74b370 could not be found. {{(pid=61492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 24 00:35:30 user devstack@n-api.service[61492]: INFO nova.api.openstack.requestlog [None req-70e33a90-88c0-4835-b6eb-b979fd1498fe tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370" status: 404 len: 111 microversion: 2.1 time: 0.118952 Apr 24 00:35:30 user devstack@n-api.service[61492]: [pid: 61492|app: 0|req: 158/461] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 24 00:35:30 2023] GET /compute/v2.1/servers/b330e0bf-027f-4d61-ba28-93465a74b370 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 24 00:35:30 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:35:30 user devstack@n-api.service[61491]: DEBUG dbcounter [-] [61491] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61491) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 24 00:35:30 user devstack@n-api.service[61491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 24 00:35:30 user devstack@n-api.service[61491]: Mon Apr 24 00:35:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-571855735 (ip 10.0.0.210) !!! Apr 24 00:35:30 user devstack@n-api.service[61491]: DEBUG nova.api.openstack.wsgi [None req-c010e552-a9ff-4461-8718-327b09447f84 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] Calling method '.version_select at 0x7fc8c37afa30>' {{(pid=61491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 24 00:35:30 user devstack@n-api.service[61491]: INFO nova.api.openstack.requestlog [None req-c010e552-a9ff-4461-8718-327b09447f84 tempest-TestMinimumBasicScenario-776289633 tempest-TestMinimumBasicScenario-776289633-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-571855735" status: 202 len: 0 microversion: 2.1 time: 0.040416 Apr 24 00:35:30 user devstack@n-api.service[61491]: [pid: 61491|app: 0|req: 151/462] 10.0.0.210 () {62 vars in 1346 bytes} [Mon Apr 24 00:35:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-571855735 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)