Apr 18 12:46:21 user devstack@n-api.service[61392]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 12:46:21 user devstack@n-api.service[61392]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 12:46:21 2023] *** Apr 18 12:46:21 user devstack@n-api.service[61392]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 12:46:21 user devstack@n-api.service[61392]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 12:46:21 user devstack@n-api.service[61392]: nodename: user Apr 18 12:46:21 user devstack@n-api.service[61392]: machine: x86_64 Apr 18 12:46:21 user devstack@n-api.service[61392]: clock source: unix Apr 18 12:46:21 user devstack@n-api.service[61392]: pcre jit disabled Apr 18 12:46:21 user devstack@n-api.service[61392]: detected number of CPU cores: 12 Apr 18 12:46:21 user devstack@n-api.service[61392]: current working directory: / Apr 18 12:46:21 user devstack@n-api.service[61392]: detected binary path: /usr/bin/uwsgi-core Apr 18 12:46:21 user devstack@n-api.service[61392]: your processes number limit is 63637 Apr 18 12:46:21 user devstack@n-api.service[61392]: your memory page size is 4096 bytes Apr 18 12:46:21 user devstack@n-api.service[61392]: detected max file descriptor number: 2048 Apr 18 12:46:21 user devstack@n-api.service[61392]: lock engine: pthread robust mutexes Apr 18 12:46:21 user devstack@n-api.service[61392]: thunder lock: enabled Apr 18 12:46:21 user devstack@n-api.service[61392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 12:46:21 user devstack@n-api.service[61392]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 12:46:21 user devstack@n-api.service[61392]: Python main interpreter initialized at 0x55ac0b0a0990 Apr 18 12:46:21 user devstack@n-api.service[61392]: python threads support enabled Apr 18 12:46:21 user devstack@n-api.service[61392]: your server socket listen backlog is limited to 100 connections Apr 18 12:46:21 user devstack@n-api.service[61392]: your mercy for graceful operations on workers is 90 seconds Apr 18 12:46:21 user devstack@n-api.service[61392]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 12:46:21 user devstack@n-api.service[61392]: *** Operational MODE: preforking *** Apr 18 12:46:21 user devstack@n-api.service[61392]: *** uWSGI is running in multiple interpreter mode *** Apr 18 12:46:21 user devstack@n-api.service[61392]: spawned uWSGI master process (pid: 61392) Apr 18 12:46:21 user devstack@n-api.service[61392]: spawned uWSGI worker 1 (pid: 61393, cores: 1) Apr 18 12:46:21 user devstack@n-api.service[61392]: spawned uWSGI worker 2 (pid: 61394, cores: 1) Apr 18 12:46:21 user devstack@n-api.service[61392]: spawned uWSGI worker 3 (pid: 61395, cores: 1) Apr 18 12:46:21 user devstack@n-api.service[61392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 12:46:22 user devstack@n-api.service[61395]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 12:46:22 user devstack@n-api.service[61393]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 12:46:22 user devstack@n-api.service[61394]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 12:46:25 user devstack@n-api.service[61395]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 12:46:25 user devstack@n-api.service[61395]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 12:46:25 user devstack@n-api.service[61395]: and ``live_migration_inbound_addr`` respectively. Apr 18 12:46:25 user devstack@n-api.service[61395]: ). Its value may be silently ignored in the future. Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 12:46:25 user devstack@n-api.service[61393]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 12:46:25 user devstack@n-api.service[61393]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 12:46:25 user devstack@n-api.service[61393]: and ``live_migration_inbound_addr`` respectively. Apr 18 12:46:25 user devstack@n-api.service[61393]: ). Its value may be silently ignored in the future. Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 12:46:25 user devstack@n-api.service[61394]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 12:46:25 user devstack@n-api.service[61394]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 12:46:25 user devstack@n-api.service[61394]: and ``live_migration_inbound_addr`` respectively. Apr 18 12:46:25 user devstack@n-api.service[61394]: ). Its value may be silently ignored in the future. Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61395) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61393) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61394) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 12:46:26 user devstack@n-api.service[61395]: INFO dbcounter [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Registered counter for database nova_api Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_db.sqlalchemy.engines [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61395) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writer thread running {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61394]: INFO dbcounter [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Registered counter for database nova_api Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG nova.context [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e2e7804-6c25-4b7a-b3e8-114c55cd91bc(cell1) {{(pid=61395) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:46:26 user devstack@n-api.service[61393]: INFO dbcounter [None req-8381d283-43db-4662-85be-853627bf54ca None None] Registered counter for database nova_api Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_db.sqlalchemy.engines [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61394) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61395]: INFO dbcounter [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Registered counter for database nova_cell0 Apr 18 12:46:26 user devstack@n-api.service[61395]: INFO dbcounter [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Registered counter for database nova_cell1 Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writer thread running {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_db.sqlalchemy.engines [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61395) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_db.sqlalchemy.engines [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61395) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writer thread running {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writer thread running {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_db.sqlalchemy.engines [None req-8381d283-43db-4662-85be-853627bf54ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writer thread running {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.context [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e2e7804-6c25-4b7a-b3e8-114c55cd91bc(cell1) {{(pid=61394) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:46:26 user devstack@n-api.service[61394]: INFO dbcounter [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Registered counter for database nova_cell0 Apr 18 12:46:26 user devstack@n-api.service[61394]: INFO dbcounter [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Registered counter for database nova_cell1 Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_db.sqlalchemy.engines [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61394) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writer thread running {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_db.sqlalchemy.engines [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61394) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG nova.context [None req-8381d283-43db-4662-85be-853627bf54ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e2e7804-6c25-4b7a-b3e8-114c55cd91bc(cell1) {{(pid=61393) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8381d283-43db-4662-85be-853627bf54ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8381d283-43db-4662-85be-853627bf54ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8381d283-43db-4662-85be-853627bf54ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8381d283-43db-4662-85be-853627bf54ca None None] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8381d283-43db-4662-85be-853627bf54ca None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8381d283-43db-4662-85be-853627bf54ca None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:46:26 user devstack@n-api.service[61393]: INFO dbcounter [None req-8381d283-43db-4662-85be-853627bf54ca None None] Registered counter for database nova_cell0 Apr 18 12:46:26 user devstack@n-api.service[61393]: INFO dbcounter [None req-8381d283-43db-4662-85be-853627bf54ca None None] Registered counter for database nova_cell1 Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_db.sqlalchemy.engines [None req-8381d283-43db-4662-85be-853627bf54ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61395]: INFO dbcounter [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Registered counter for database nova_cell0 Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writer thread running {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG oslo_db.sqlalchemy.engines [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61395) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writer thread running {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writer thread running {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61394]: INFO dbcounter [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Registered counter for database nova_cell0 Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG oslo_db.sqlalchemy.engines [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61394) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writer thread running {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_db.sqlalchemy.engines [None req-8381d283-43db-4662-85be-853627bf54ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writer thread running {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61393]: INFO dbcounter [None req-8381d283-43db-4662-85be-853627bf54ca None None] Registered counter for database nova_cell0 Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG oslo_db.sqlalchemy.engines [None req-8381d283-43db-4662-85be-853627bf54ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 12:46:26 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writer thread running {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 12:46:26 user devstack@n-api.service[61394]: WARNING keystonemiddleware.auth_token [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 12:46:26 user devstack@n-api.service[61395]: WARNING keystonemiddleware.auth_token [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 12:46:26 user devstack@n-api.service[61394]: WARNING keystonemiddleware.auth_token [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 12:46:26 user devstack@n-api.service[61395]: WARNING keystonemiddleware.auth_token [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 12:46:26 user devstack@n-api.service[61394]: WARNING keystonemiddleware.auth_token [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 12:46:26 user devstack@n-api.service[61394]: WARNING keystonemiddleware.auth_token [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 12:46:26 user devstack@n-api.service[61394]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac0b0a0990 pid: 61394 (default app) Apr 18 12:46:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:46:26 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001716 Apr 18 12:46:26 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 12:46:26 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:46:26 user devstack@n-api.service[61395]: WARNING keystonemiddleware.auth_token [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 12:46:26 user devstack@n-api.service[61395]: WARNING keystonemiddleware.auth_token [None req-aaafb38e-2f36-415a-8e04-30fa429370bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 12:46:26 user devstack@n-api.service[61395]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac0b0a0990 pid: 61395 (default app) Apr 18 12:46:26 user devstack@n-api.service[61393]: WARNING keystonemiddleware.auth_token [None req-8381d283-43db-4662-85be-853627bf54ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 12:46:26 user devstack@n-api.service[61393]: WARNING keystonemiddleware.auth_token [None req-8381d283-43db-4662-85be-853627bf54ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 12:46:27 user devstack@n-api.service[61393]: WARNING keystonemiddleware.auth_token [None req-8381d283-43db-4662-85be-853627bf54ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 12:46:27 user devstack@n-api.service[61393]: WARNING keystonemiddleware.auth_token [None req-8381d283-43db-4662-85be-853627bf54ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 12:46:27 user devstack@n-api.service[61393]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac0b0a0990 pid: 61393 (default app) Apr 18 12:48:34 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-95fad531-8eae-429c-b5a0-e9dafdd74487 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001641 Apr 18 12:48:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:34 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:34 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:34 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:34 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:34 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b0edba5b-2044-4528-b66a-f4f374baef1b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:35 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b0edba5b-2044-4528-b66a-f4f374baef1b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.423217 Apr 18 12:48:35 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 12:48:34 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:36 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8381d283-43db-4662-85be-853627bf54ca None None] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:36 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8381d283-43db-4662-85be-853627bf54ca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002904 Apr 18 12:48:36 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:36 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:36 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=3 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:36 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=3 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:36 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=3 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:36 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=3 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:37 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-35098e3d-632a-4d26-a28c-85617a7f509f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "id": "c1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:37 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-35098e3d-632a-4d26-a28c-85617a7f509f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.333261 Apr 18 12:48:37 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:36 2023] POST /compute/v2.1/flavors => generated 405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:37 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-2516f928-7d1a-439b-99a6-94ae491df312 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:37 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-2516f928-7d1a-439b-99a6-94ae491df312 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047719 Apr 18 12:48:37 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 12:48:37 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:39 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8381d283-43db-4662-85be-853627bf54ca None None] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:39 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8381d283-43db-4662-85be-853627bf54ca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001447 Apr 18 12:48:39 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:39 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-52dd67b8-3f8f-4846-b734-f30fad87ac03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-52dd67b8-3f8f-4846-b734-f30fad87ac03 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074213 Apr 18 12:48:39 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:39 2023] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:39 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-a2c12e71-fd02-4a18-9264-ee2ede6958a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:39 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-a2c12e71-fd02-4a18-9264-ee2ede6958a7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028719 Apr 18 12:48:39 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 12:48:39 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:41 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8381d283-43db-4662-85be-853627bf54ca None None] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8381d283-43db-4662-85be-853627bf54ca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001791 Apr 18 12:48:41 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:41 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-a60c7531-1f0e-4b6a-bad0-d6d93209658d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "disk": 10}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:41 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-a60c7531-1f0e-4b6a-bad0-d6d93209658d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067201 Apr 18 12:48:41 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:41 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:41 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-1528fdd3-d66a-4066-b0d9-1f24060c58e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:41 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-1528fdd3-d66a-4066-b0d9-1f24060c58e6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027288 Apr 18 12:48:41 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 12:48:41 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:43 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8381d283-43db-4662-85be-853627bf54ca None None] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:43 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8381d283-43db-4662-85be-853627bf54ca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001965 Apr 18 12:48:43 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:43 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:43 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d3685faa-5139-4778-a47d-3e820decfc10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "vcpus": 2, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:43 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-d3685faa-5139-4778-a47d-3e820decfc10 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059313 Apr 18 12:48:43 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:43 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 12:48:43 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-0e3f1c01-561e-409c-afd7-82b34fca7230 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:43 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-0e3f1c01-561e-409c-afd7-82b34fca7230 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026729 Apr 18 12:48:43 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 12:48:43 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:45 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8381d283-43db-4662-85be-853627bf54ca None None] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:45 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8381d283-43db-4662-85be-853627bf54ca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001338 Apr 18 12:48:45 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:45 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-ea243f02-7d4b-4f45-a8b4-31af6f6277d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:45 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-ea243f02-7d4b-4f45-a8b4-31af6f6277d4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063432 Apr 18 12:48:45 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:45 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:45 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:45 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027926 Apr 18 12:48:45 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 12:48:45 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:47 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8381d283-43db-4662-85be-853627bf54ca None None] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:47 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8381d283-43db-4662-85be-853627bf54ca None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001765 Apr 18 12:48:47 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:47 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-97532f2e-8a8e-456f-9e81-4c1bdeb520d2 admin admin] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:47 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-97532f2e-8a8e-456f-9e81-4c1bdeb520d2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.071173 Apr 18 12:48:47 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 12:48:47 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:48:49 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:49 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001578 Apr 18 12:48:49 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:49 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:49 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:49 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:49 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:49 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:48:49 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-58ac5902-f68a-4aec-89e2-da9795488642 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:49 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-58ac5902-f68a-4aec-89e2-da9795488642 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.545417 Apr 18 12:48:49 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:49 2023] POST /compute/v2.1/flavors => generated 400 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:49 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-3752ffdd-ca04-42e4-b7d9-518b5de0635b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:49 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-3752ffdd-ca04-42e4-b7d9-518b5de0635b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037237 Apr 18 12:48:49 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 12:48:49 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:51 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:51 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001375 Apr 18 12:48:51 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:51 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-b3750b6a-a779-43c6-acfe-3f33c074fcb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "swap": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:51 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-b3750b6a-a779-43c6-acfe-3f33c074fcb6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059184 Apr 18 12:48:51 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:51 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:51 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-050b8670-87e9-49e3-a865-7a63253fde54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:51 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-050b8670-87e9-49e3-a865-7a63253fde54 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025874 Apr 18 12:48:51 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 12:48:51 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:53 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:53 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001349 Apr 18 12:48:53 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:53 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ccd26fa9-1a28-4035-b98d-035bc9933dc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:53 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ccd26fa9-1a28-4035-b98d-035bc9933dc2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.058939 Apr 18 12:48:53 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:53 2023] POST /compute/v2.1/flavors => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:53 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-5004747c-e8e8-4ebc-a960-2c8ebf9f9c8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:53 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-5004747c-e8e8-4ebc-a960-2c8ebf9f9c8f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023272 Apr 18 12:48:53 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 12:48:53 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:55 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001415 Apr 18 12:48:55 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:55 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:55 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-e0570aaa-1784-4a11-92e4-d3c9e19c85a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4"}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:55 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-e0570aaa-1784-4a11-92e4-d3c9e19c85a9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062627 Apr 18 12:48:55 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:55 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:55 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-3e6af3c3-ac6f-4fa8-9cf9-41f2702ed0c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:55 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-3e6af3c3-ac6f-4fa8-9cf9-41f2702ed0c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.022520 Apr 18 12:48:55 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 12:48:55 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:48:58 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:48:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001421 Apr 18 12:48:58 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 12:48:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:48:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-0cb47d03-eba4-4731-8b5b-23c0db939758 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:58 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-0cb47d03-eba4-4731-8b5b-23c0db939758 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.064408 Apr 18 12:48:58 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 12:48:58 2023] POST /compute/v2.1/flavors => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:48:58 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f9fbb8f6-e226-4b73-a572-5a438bb2fc6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:48:58 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f9fbb8f6-e226-4b73-a572-5a438bb2fc6e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024920 Apr 18 12:48:58 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 12:48:58 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:49:28 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:49:28 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e7104737-49b6-4ea1-83e1-d2ad5429ed2b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001600 Apr 18 12:49:28 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 12:49:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:49:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:49:28 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.093649 Apr 18 12:49:28 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 12:49:28 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:50:00 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f9fbb8f6-e226-4b73-a572-5a438bb2fc6e admin admin] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:50:00 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f9fbb8f6-e226-4b73-a572-5a438bb2fc6e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001419 Apr 18 12:50:00 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 12:50:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:50:00 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:50:00 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-3fb998aa-414b-41f9-bfcb-3b26f153ccb1 admin admin] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:50:00 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-3fb998aa-414b-41f9-bfcb-3b26f153ccb1 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.066902 Apr 18 12:50:00 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 12:50:00 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:50:04 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:50:04 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001380 Apr 18 12:50:04 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 12:50:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:50:04 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:50:05 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-c201d115-33e1-49f2-9bab-9d10dd74e1c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "42", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.nano", "swap": 0, "ram": 128, "disk": 1}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:50:05 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-c201d115-33e1-49f2-9bab-9d10dd74e1c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061878 Apr 18 12:50:05 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 12:50:04 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:50:05 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-66ce6167-8194-45dc-b2aa-a15387ee8a96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:50:05 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-66ce6167-8194-45dc-b2aa-a15387ee8a96 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025091 Apr 18 12:50:05 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 12:50:05 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:50:09 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:50:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ddaed82e-3db2-4823-b3e0-14f484c6d444 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001357 Apr 18 12:50:09 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 12:50:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:50:09 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-8704c985-cce4-40da-9b70-cefd5e24738c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "84", "name": "m1.micro", "vcpus": 1}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:50:09 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-8704c985-cce4-40da-9b70-cefd5e24738c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063015 Apr 18 12:50:09 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 12:50:09 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:50:09 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-cf2076b0-10aa-4a1a-8892-8334434761d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:50:09 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-cf2076b0-10aa-4a1a-8892-8334434761d0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023453 Apr 18 12:50:09 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 12:50:09 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:52:21 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:21 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:21 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:21 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-073c0fa1-0377-43ab-b724-33888f796a15 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Action: 'create', calling method: .version_select at 0x7fcf0da82cb0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1169850649"}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:23 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-073c0fa1-0377-43ab-b724-33888f796a15 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.389805 Apr 18 12:52:23 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 12:52:21 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1422 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 12:52:23 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-979f5678-35dc-4ae4-a0d9-156d16e9c752 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Calling method '.version_select at 0x7fcf0da7dfc0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:23 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-979f5678-35dc-4ae4-a0d9-156d16e9c752 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1" status: 200 len: 342 microversion: 2.1 time: 0.342431 Apr 18 12:52:23 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 12:52:23 2023] GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1 => generated 342 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:52:24 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:24 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-3edc207d-d24a-485e-95a8-1411ba732ce9 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Calling method '.version_select at 0x7fcf0dbf3490>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:24 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-3edc207d-d24a-485e-95a8-1411ba732ce9 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1" status: 200 len: 342 microversion: 2.1 time: 0.395822 Apr 18 12:52:24 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 12:52:24 2023] GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1 => generated 342 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:52:24 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-dcb12872-3242-40e2-9b4c-13e52a1bca89 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Calling method '.version_select at 0x7fcf0d90c430>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-dcb12872-3242-40e2-9b4c-13e52a1bca89 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1" status: 202 len: 0 microversion: 2.1 time: 0.326605 Apr 18 12:52:25 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 12:52:24 2023] DELETE /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 18 12:52:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-065a7670-1e81-470b-86e3-028aba8ad382 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Calling method '.version_select at 0x7fcf0d903880>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-065a7670-1e81-470b-86e3-028aba8ad382 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] HTTP exception thrown: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. Apr 18 12:52:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-065a7670-1e81-470b-86e3-028aba8ad382 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Request method failure captured: Apr 18 12:52:25 user devstack@n-api.service[61394]: request: GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1 HTTP/1.1 Apr 18 12:52:25 user devstack@n-api.service[61394]: Accept: application/json Apr 18 12:52:25 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 12:52:25 user devstack@n-api.service[61394]: Connection: close Apr 18 12:52:25 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 12:52:25 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 12:52:25 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 12:52:25 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 12:52:25 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpKFluHu0uZUHRUMEeQxaXCAlRvz_YYwAOR5b--IIogqhBMLaiK2TKS0LQS07mGvuxC89j9xC9diGGdRrKqtrfIp8g3tuPHfOkJYZcF8jefyIETfLhsqSgk4k6IFTxm6JizBLFR-pQbDdsOhwocm41mYWVzI_wG2YBNEIM9V_PGeZSo Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Project-Id: aa107c3609af45539a76bbba6a6254a5 Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2089432518 Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa107c3609af45539a76bbba6a6254a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aa107c3609af45539a76bbba6a6254a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa107c3609af45539a76bbba6a6254a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2089432518 Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Tenant-Id: aa107c3609af45539a76bbba6a6254a5 Apr 18 12:52:25 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2089432518 Apr 18 12:52:25 user devstack@n-api.service[61394]: X-User: tempest-VolumesSnapshotsTestJSON-2089432518-project-member Apr 18 12:52:25 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 12:52:25 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 12:52:25 user devstack@n-api.service[61394]: X-User-Id: 98489390e5ab46d4a1974b395fa6855f Apr 18 12:52:25 user devstack@n-api.service[61394]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2089432518-project-member Apr 18 12:52:25 user devstack@n-api.service[61394]: method: Apr 18 12:52:25 user devstack@n-api.service[61394]: exception: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. Apr 18 12:52:25 user devstack@n-api.service[61394]: action_args: {'id': '8d15b300-4c67-4294-8342-1aa21fccf5a1'} Apr 18 12:52:25 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. (HTTP 404) (Request-ID: req-edc0757e-50b2-40a0-b02a-9e825b342330) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. Apr 18 12:52:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:52:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-065a7670-1e81-470b-86e3-028aba8ad382 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] Returning 404 to user: Volume 8d15b300-4c67-4294-8342-1aa21fccf5a1 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:52:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-065a7670-1e81-470b-86e3-028aba8ad382 tempest-VolumesSnapshotsTestJSON-2089432518 tempest-VolumesSnapshotsTestJSON-2089432518-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1" status: 404 len: 109 microversion: 2.1 time: 0.046612 Apr 18 12:52:25 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 12:52:25 2023] GET /compute/v2.1/os-volumes/8d15b300-4c67-4294-8342-1aa21fccf5a1 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:52:35 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-1e8cdab4-5697-46aa-a2aa-12d3e4dda2f6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d903130>, body: {"keypair": {"name": "tempest-keypair-20614186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV1iTjCGPNGxgVxnW4T6Qhc4IXzWXlbLVb2wuh8bA8NrJsmplDdk6/LUgB7lkKSQomZy0STiAOjZ6l9J0VtusQkEsKOAN3yWExj34/p+UHDllz42sRlL/d/u/q4xDO4vQ=="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:35 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-1e8cdab4-5697-46aa-a2aa-12d3e4dda2f6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Getting quotas for project 542eb5fc47614fcb9d244b0ea58fc979. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:52:35 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-1e8cdab4-5697-46aa-a2aa-12d3e4dda2f6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Getting quotas for user 448cad17bf74486ca000696c14625592 and project 542eb5fc47614fcb9d244b0ea58fc979. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:52:35 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-1e8cdab4-5697-46aa-a2aa-12d3e4dda2f6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.381909 Apr 18 12:52:35 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:52:35 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:52:43 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-615709756", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "dad026b3-ca1f-4ef6-b0c1-b68b9e248f72"}]}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:43 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] validate_networks() for [('dad026b3-ca1f-4ef6-b0c1-b68b9e248f72', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:52:44 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-899782450", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5a7608a5-4de5-46b6-bfee-78089cd9f01b"}], "security_groups": [{"name": "tempest-securitygroup--1776928704"}], "key_name": "tempest-keypair-20614186", "user_data": "}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:44 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] validate_networks() for [('5a7608a5-4de5-46b6-bfee-78089cd9f01b', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Getting quotas for project 484b27326e0b478f89ff2a705df576d0. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Getting quotas for user d6bc560a69f7412d9e07c7abfed885da and project 484b27326e0b478f89ff2a705df576d0. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:52:46 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5c481e5e-d6bd-4df5-8ad3-827406731b81 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.399043 Apr 18 12:52:46 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:52:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 3400 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:52:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=4 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:46 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-ba24d44b-220e-426b-bb7d-49bb4b247682 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:46 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-ba24d44b-220e-426b-bb7d-49bb4b247682 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:52:46 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-ba24d44b-220e-426b-bb7d-49bb4b247682 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc560a69f7412d9e07c7abfed885da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484b27326e0b478f89ff2a705df576d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:52:46 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-ba24d44b-220e-426b-bb7d-49bb4b247682 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442" status: 200 len: 1208 microversion: 2.1 time: 0.106143 Apr 18 12:52:46 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:52:46 2023] GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442 => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Getting quotas for project 542eb5fc47614fcb9d244b0ea58fc979. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Getting quotas for user 448cad17bf74486ca000696c14625592 and project 542eb5fc47614fcb9d244b0ea58fc979. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:52:46 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:52:46 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-8cf4ff14-9220-4d21-bd39-48d4025f559b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.833088 Apr 18 12:52:46 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 19/54] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:52:44 2023] POST /compute/v2.1/servers => generated 407 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-460d4429-ce4b-456b-a663-fa05b9cec8eb tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:46 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-460d4429-ce4b-456b-a663-fa05b9cec8eb tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:52:47 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-460d4429-ce4b-456b-a663-fa05b9cec8eb tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:52:47 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-460d4429-ce4b-456b-a663-fa05b9cec8eb tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1230 microversion: 2.1 time: 0.119445 Apr 18 12:52:47 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:52:46 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:52:49 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-824344747", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "a065d353-7a7d-475d-b1f0-65db1dd7dfa8"}]}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:49 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] validate_networks() for [('a065d353-7a7d-475d-b1f0-65db1dd7dfa8', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "189acda6-7b91-4a07-91bc-115f8070a442", "tag": "3125f737-5918-4f42-a29b-51b3f8a5f57c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Getting quotas for project a76859b643e84f8f83b6092498f0f2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Getting quotas for user decaeb6e67f94c7a87fb782e089621f9 and project a76859b643e84f8f83b6092498f0f2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:52:52 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Creating event network-changed:3125f737-5918-4f42-a29b-51b3f8a5f57c for instance 189acda6-7b91-4a07-91bc-115f8070a442 on user Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-cc4c924b-89e4-4f18-97bb-fd07a1e2e885 req-bf2b0181-6d0e-4302-a3af-f489cd730d11 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:52 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:52:52 user devstack@n-api.service[61394]: INFO nova.compute.rpcapi [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 12:52:52 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] Releasing lock "compute-rpcapi-router" {{(pid=61394) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 12:52:52 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-98235b9c-05f6-4e06-bc16-dcb0864b3091 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187027 Apr 18 12:52:52 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 20/56] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:52:52 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-5fbcf42e-9dec-457b-abfa-5b2848e4b3f5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.067392 Apr 18 12:52:52 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:52:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 3069 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:52:52 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-22d3c8dd-1a95-454d-a2d4-d61988adb811 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:52:52 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-22d3c8dd-1a95-454d-a2d4-d61988adb811 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:52:52 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-22d3c8dd-1a95-454d-a2d4-d61988adb811 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:52:52 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-22d3c8dd-1a95-454d-a2d4-d61988adb811 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1210 microversion: 2.1 time: 0.076822 Apr 18 12:52:52 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:52:52 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1210 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:52:55 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-b8e1bc1e-09c0-4479-9f7b-7f13ae251ee0 req-98cbfaf8-8d74-486c-9889-3471f3f403f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b8e1bc1e-09c0-4479-9f7b-7f13ae251ee0 req-98cbfaf8-8d74-486c-9889-3471f3f403f0 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b8e1bc1e-09c0-4479-9f7b-7f13ae251ee0 req-98cbfaf8-8d74-486c-9889-3471f3f403f0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b8e1bc1e-09c0-4479-9f7b-7f13ae251ee0 req-98cbfaf8-8d74-486c-9889-3471f3f403f0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:55 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-b8e1bc1e-09c0-4479-9f7b-7f13ae251ee0 req-98cbfaf8-8d74-486c-9889-3471f3f403f0 service nova] Creating event network-changed:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 12:52:55 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-b8e1bc1e-09c0-4479-9f7b-7f13ae251ee0 req-98cbfaf8-8d74-486c-9889-3471f3f403f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114717 Apr 18 12:52:55 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189acda6-7b91-4a07-91bc-115f8070a442", "name": "network-vif-plugged", "status": "completed", "tag": "3125f737-5918-4f42-a29b-51b3f8a5f57c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Creating event network-vif-plugged:3125f737-5918-4f42-a29b-51b3f8a5f57c for instance 189acda6-7b91-4a07-91bc-115f8070a442 on user Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61395) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c60d7642-8a7f-45a8-a680-469cebe72820 req-2befb819-c255-47c1-b0ec-b5054f8def05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61395) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:58 user devstack@n-api.service[61395]: INFO nova.compute.rpcapi [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 12:52:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] Releasing lock "compute-rpcapi-router" {{(pid=61395) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 12:52:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-9be90a00-99f2-420c-a8a6-5c5b5e10c4ed None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141304 Apr 18 12:52:58 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898", "tag": "026f2768-4256-4d5c-a1f9-15c5069d9f5c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:58 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Creating event network-changed:026f2768-4256-4d5c-a1f9-15c5069d9f5c for instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 on user Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61393) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-f1d894e3-a9bb-45c6-9ce8-b5eee19b50a1 req-222e6501-cf5b-438b-a365-9bbd47d1193a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61393) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:52:58 user devstack@n-api.service[61393]: INFO nova.compute.rpcapi [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 12:52:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=61393) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 12:52:58 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c8990624-045c-4ec3-8292-bdbeb4e189b1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085347 Apr 18 12:52:58 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:52:58 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:52:58 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-db900095-57fe-4059-a776-039fcbc9de4a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d85f2e0>, body: {"keypair": {"name": "tempest-keypair-19442091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAltj11tn/Z31Dzu8k8GNr21qq2oMUyoc47GE5tcY6LHe7WwQwqxrYP4iPPrJ6SMe4lUXKEhrfCabxiQnWdJnqrSsHWQd53LImGrnEuyOMojNjSoAZ9Fy9y14qTCHHfqQw=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:52:58 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-db900095-57fe-4059-a776-039fcbc9de4a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Getting quotas for project f100c45c0a3f42c89a9b63303871d801. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:52:58 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-db900095-57fe-4059-a776-039fcbc9de4a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Getting quotas for user 175c9e4b73b04177a12fefc47c8879c7 and project f100c45c0a3f42c89a9b63303871d801. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:52:58 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-db900095-57fe-4059-a776-039fcbc9de4a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.180453 Apr 18 12:52:58 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 22/62] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:52:58 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:00 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189acda6-7b91-4a07-91bc-115f8070a442", "name": "network-vif-plugged", "status": "completed", "tag": "3125f737-5918-4f42-a29b-51b3f8a5f57c"}, {"server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "name": "network-vif-plugged", "status": "completed", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:00 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:00 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:00 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:00 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] Creating event network-vif-plugged:3125f737-5918-4f42-a29b-51b3f8a5f57c for instance 189acda6-7b91-4a07-91bc-115f8070a442 on user Apr 18 12:53:00 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] Creating event network-vif-plugged:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 12:53:00 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-4769b803-5e71-41ac-8dfe-aae2e7f80a48 req-aceda66b-286a-464f-a62f-9ba45e2674d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049705 Apr 18 12:53:00 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:01 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1804986100", "imageRef": "d7d8eba2-526e-4eee-8a0a-a018c7a3cc03", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3a3d3908-a17d-4f5f-9890-1812a8754872"}], "security_groups": [{"name": "tempest-securitygroup--1039835090"}], "key_name": "tempest-keypair-19442091", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:02 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] validate_networks() for [('3a3d3908-a17d-4f5f-9890-1812a8754872', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:53:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-093d1aad-7fb7-4d01-b4c6-dc2aba80fddf req-0285b99f-fd92-4758-b702-1e5d46964ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "name": "network-vif-plugged", "status": "completed", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-093d1aad-7fb7-4d01-b4c6-dc2aba80fddf req-0285b99f-fd92-4758-b702-1e5d46964ac3 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-093d1aad-7fb7-4d01-b4c6-dc2aba80fddf req-0285b99f-fd92-4758-b702-1e5d46964ac3 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-093d1aad-7fb7-4d01-b4c6-dc2aba80fddf req-0285b99f-fd92-4758-b702-1e5d46964ac3 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:02 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-093d1aad-7fb7-4d01-b4c6-dc2aba80fddf req-0285b99f-fd92-4758-b702-1e5d46964ac3 service nova] Creating event network-vif-plugged:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 12:53:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-093d1aad-7fb7-4d01-b4c6-dc2aba80fddf req-0285b99f-fd92-4758-b702-1e5d46964ac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058445 Apr 18 12:53:02 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:02 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=10 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:02 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=8 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4ab04059-5fa4-4032-9818-3d75fb7fb503 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d88d3f0>, body: {"keypair": {"name": "tempest-keypair-497184784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZFBLvfzQILr9/7qWzwP6NVRn1fJRx/SZjHiHu1Caj7+wejLMQte/Opl2kwmqk41F+QQD9jGGeeN2UtZh9EiIi+L33s930v357mdVU4YUaaw2ZJgbYNAcLXTZdlmN2erA=="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:03 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-4ab04059-5fa4-4032-9818-3d75fb7fb503 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Getting quotas for project 4c47472a1a3e4494801cea627fe6cb66. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:03 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-4ab04059-5fa4-4032-9818-3d75fb7fb503 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Getting quotas for user a37faecb47ed4c8e8dea21ee364164e5 and project 4c47472a1a3e4494801cea627fe6cb66. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:03 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-4ab04059-5fa4-4032-9818-3d75fb7fb503 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295684 Apr 18 12:53:03 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:53:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:03 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-a51ad5d9-1e0f-4ac3-be7a-5802eba44a08 req-44e8dab0-8d17-4a52-b977-add5fb75c45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898", "name": "network-vif-plugged", "status": "completed", "tag": "026f2768-4256-4d5c-a1f9-15c5069d9f5c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a51ad5d9-1e0f-4ac3-be7a-5802eba44a08 req-44e8dab0-8d17-4a52-b977-add5fb75c45e service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a51ad5d9-1e0f-4ac3-be7a-5802eba44a08 req-44e8dab0-8d17-4a52-b977-add5fb75c45e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a51ad5d9-1e0f-4ac3-be7a-5802eba44a08 req-44e8dab0-8d17-4a52-b977-add5fb75c45e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:03 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-a51ad5d9-1e0f-4ac3-be7a-5802eba44a08 req-44e8dab0-8d17-4a52-b977-add5fb75c45e service nova] Creating event network-vif-plugged:026f2768-4256-4d5c-a1f9-15c5069d9f5c for instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 on user Apr 18 12:53:03 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-a51ad5d9-1e0f-4ac3-be7a-5802eba44a08 req-44e8dab0-8d17-4a52-b977-add5fb75c45e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060436 Apr 18 12:53:03 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 24/66] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Getting quotas for project f100c45c0a3f42c89a9b63303871d801. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Getting quotas for user 175c9e4b73b04177a12fefc47c8879c7 and project f100c45c0a3f42c89a9b63303871d801. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:53:04 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d7d8eba2-526e-4eee-8a0a-a018c7a3cc03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:53:04 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-733ea0fd-540d-4713-a3c1-89277181372d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.222480 Apr 18 12:53:04 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 21/67] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:53:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 3224 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:53:04 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e4196d0e-c9c8-4201-8c81-694ce666c806 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:04 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-e4196d0e-c9c8-4201-8c81-694ce666c806 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:05 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-e4196d0e-c9c8-4201-8c81-694ce666c806 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c9e4b73b04177a12fefc47c8879c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100c45c0a3f42c89a9b63303871d801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:05 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e4196d0e-c9c8-4201-8c81-694ce666c806 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 200 len: 1238 microversion: 2.1 time: 0.182556 Apr 18 12:53:05 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:04 2023] GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 1238 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:53:05 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-8d9d6b36-2092-49aa-83b9-70c1404f7dd6 req-9916256f-98f5-4cd4-b7ca-bcf0cf1df617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898", "name": "network-vif-plugged", "status": "completed", "tag": "026f2768-4256-4d5c-a1f9-15c5069d9f5c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:05 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8d9d6b36-2092-49aa-83b9-70c1404f7dd6 req-9916256f-98f5-4cd4-b7ca-bcf0cf1df617 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:05 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8d9d6b36-2092-49aa-83b9-70c1404f7dd6 req-9916256f-98f5-4cd4-b7ca-bcf0cf1df617 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:05 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8d9d6b36-2092-49aa-83b9-70c1404f7dd6 req-9916256f-98f5-4cd4-b7ca-bcf0cf1df617 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:05 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-8d9d6b36-2092-49aa-83b9-70c1404f7dd6 req-9916256f-98f5-4cd4-b7ca-bcf0cf1df617 service nova] Creating event network-vif-plugged:026f2768-4256-4d5c-a1f9-15c5069d9f5c for instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 on user Apr 18 12:53:05 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-8d9d6b36-2092-49aa-83b9-70c1404f7dd6 req-9916256f-98f5-4cd4-b7ca-bcf0cf1df617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063952 Apr 18 12:53:05 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:09 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-3556b3b5-7b15-484f-8679-36726ef38d17 req-3eaf4044-619f-49a7-8271-072b9d5f16e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-3556b3b5-7b15-484f-8679-36726ef38d17 req-3eaf4044-619f-49a7-8271-072b9d5f16e8 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-3556b3b5-7b15-484f-8679-36726ef38d17 req-3eaf4044-619f-49a7-8271-072b9d5f16e8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-3556b3b5-7b15-484f-8679-36726ef38d17 req-3eaf4044-619f-49a7-8271-072b9d5f16e8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-3556b3b5-7b15-484f-8679-36726ef38d17 req-3eaf4044-619f-49a7-8271-072b9d5f16e8 service nova] Creating event network-changed:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:53:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-3556b3b5-7b15-484f-8679-36726ef38d17 req-3eaf4044-619f-49a7-8271-072b9d5f16e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060215 Apr 18 12:53:09 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 22/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:10 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-178480087", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "bcaa4fb9-53c1-43e9-b346-002b19ab58ad"}], "security_groups": [{"name": "tempest-securitygroup--2014054684"}], "key_name": "tempest-keypair-497184784", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:10 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=4 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:10 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=8 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:10 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] validate_networks() for [('bcaa4fb9-53c1-43e9-b346-002b19ab58ad', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Getting quotas for project 4c47472a1a3e4494801cea627fe6cb66. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Getting quotas for user a37faecb47ed4c8e8dea21ee364164e5 and project 4c47472a1a3e4494801cea627fe6cb66. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:53:11 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:53:11 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-5acab62d-6e1b-4c49-955a-e4ae31c4de33 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.352135 Apr 18 12:53:11 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:53:10 2023] POST /compute/v2.1/servers => generated 404 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:53:11 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:11 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-bce68af8-c1cc-4ed4-9b89-4626085e71e1 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:11 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-bce68af8-c1cc-4ed4-9b89-4626085e71e1 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:11 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-bce68af8-c1cc-4ed4-9b89-4626085e71e1 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37faecb47ed4c8e8dea21ee364164e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c47472a1a3e4494801cea627fe6cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-bce68af8-c1cc-4ed4-9b89-4626085e71e1 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114" status: 200 len: 1234 microversion: 2.1 time: 0.324639 Apr 18 12:53:11 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 26/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:11 2023] GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114 => generated 1234 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:53:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-49df1135-009e-4a55-a42d-65568440fcc9 req-96c1e91d-e1e7-4e2c-b83c-5608304a36ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "name": "network-vif-plugged", "status": "completed", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:14 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-49df1135-009e-4a55-a42d-65568440fcc9 req-96c1e91d-e1e7-4e2c-b83c-5608304a36ce service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-49df1135-009e-4a55-a42d-65568440fcc9 req-96c1e91d-e1e7-4e2c-b83c-5608304a36ce service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-49df1135-009e-4a55-a42d-65568440fcc9 req-96c1e91d-e1e7-4e2c-b83c-5608304a36ce service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:14 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-49df1135-009e-4a55-a42d-65568440fcc9 req-96c1e91d-e1e7-4e2c-b83c-5608304a36ce service nova] Creating event network-vif-plugged:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:53:14 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-49df1135-009e-4a55-a42d-65568440fcc9 req-96c1e91d-e1e7-4e2c-b83c-5608304a36ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040968 Apr 18 12:53:14 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 23/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:16 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-de6ed34d-68c5-4c64-bc63-baa2408dde02 req-ef7f8437-99bc-48f3-ac28-49b738966102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "name": "network-vif-plugged", "status": "completed", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-de6ed34d-68c5-4c64-bc63-baa2408dde02 req-ef7f8437-99bc-48f3-ac28-49b738966102 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-de6ed34d-68c5-4c64-bc63-baa2408dde02 req-ef7f8437-99bc-48f3-ac28-49b738966102 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-de6ed34d-68c5-4c64-bc63-baa2408dde02 req-ef7f8437-99bc-48f3-ac28-49b738966102 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:16 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-de6ed34d-68c5-4c64-bc63-baa2408dde02 req-ef7f8437-99bc-48f3-ac28-49b738966102 service nova] Creating event network-vif-plugged:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:53:16 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-de6ed34d-68c5-4c64-bc63-baa2408dde02 req-ef7f8437-99bc-48f3-ac28-49b738966102 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040878 Apr 18 12:53:16 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:17 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-5404a3f8-e97c-4a54-86bc-d466b2b27140 req-b7379593-a67e-4988-be25-621cbf2b255c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:17 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=14 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:17 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:17 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5404a3f8-e97c-4a54-86bc-d466b2b27140 req-b7379593-a67e-4988-be25-621cbf2b255c service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:17 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5404a3f8-e97c-4a54-86bc-d466b2b27140 req-b7379593-a67e-4988-be25-621cbf2b255c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:17 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5404a3f8-e97c-4a54-86bc-d466b2b27140 req-b7379593-a67e-4988-be25-621cbf2b255c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:17 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-5404a3f8-e97c-4a54-86bc-d466b2b27140 req-b7379593-a67e-4988-be25-621cbf2b255c service nova] Creating event network-changed:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:53:17 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-5404a3f8-e97c-4a54-86bc-d466b2b27140 req-b7379593-a67e-4988-be25-621cbf2b255c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049772 Apr 18 12:53:17 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:21 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:21 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=6 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:21 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-973527b0-8be0-4bac-99a9-12248be22128 req-4f03a6ee-083a-4426-888a-7ab4fba748e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "name": "network-vif-plugged", "status": "completed", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-973527b0-8be0-4bac-99a9-12248be22128 req-4f03a6ee-083a-4426-888a-7ab4fba748e8 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-973527b0-8be0-4bac-99a9-12248be22128 req-4f03a6ee-083a-4426-888a-7ab4fba748e8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-973527b0-8be0-4bac-99a9-12248be22128 req-4f03a6ee-083a-4426-888a-7ab4fba748e8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:21 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-973527b0-8be0-4bac-99a9-12248be22128 req-4f03a6ee-083a-4426-888a-7ab4fba748e8 service nova] Creating event network-vif-plugged:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:53:21 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-973527b0-8be0-4bac-99a9-12248be22128 req-4f03a6ee-083a-4426-888a-7ab4fba748e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098091 Apr 18 12:53:21 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 24/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=12 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-79dc2539-5891-4c52-ba02-c5fad6fc1517 req-d3080211-4dcc-4ce9-8559-83edfddf8d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "name": "network-vif-plugged", "status": "completed", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=7 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-79dc2539-5891-4c52-ba02-c5fad6fc1517 req-d3080211-4dcc-4ce9-8559-83edfddf8d73 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-79dc2539-5891-4c52-ba02-c5fad6fc1517 req-d3080211-4dcc-4ce9-8559-83edfddf8d73 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-79dc2539-5891-4c52-ba02-c5fad6fc1517 req-d3080211-4dcc-4ce9-8559-83edfddf8d73 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:23 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-79dc2539-5891-4c52-ba02-c5fad6fc1517 req-d3080211-4dcc-4ce9-8559-83edfddf8d73 service nova] Creating event network-vif-plugged:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:53:23 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-79dc2539-5891-4c52-ba02-c5fad6fc1517 req-d3080211-4dcc-4ce9-8559-83edfddf8d73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057869 Apr 18 12:53:23 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:31 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-c87761ab-103d-46df-9c0c-ad47c1cc297d tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d8b1870>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1275329585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJqYuPia2pW0Fpzy8tt2IfHoPqWAnbO2GJO/XpF0+MUYBUqJv5QTUiOU3aGQSMPuIjbgFcwUu+vE5ZjzupAw/7MjDwHrur9mP4vIvbbqHokJKAeSpAQdc+uOvrLDZHPIQ=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:31 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:31 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:31 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:31 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-c87761ab-103d-46df-9c0c-ad47c1cc297d tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:31 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-c87761ab-103d-46df-9c0c-ad47c1cc297d tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for user 09e7674bd0a24feead88eb5b7338ae99 and project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:31 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-c87761ab-103d-46df-9c0c-ad47c1cc297d tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050385 Apr 18 12:53:31 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 28/78] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:53:31 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:31 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:31 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=12 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:31 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-453913307", "imageRef": "d7c5986f-f60d-4dfa-9c19-900f91c0c7ba", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1275329585", "networks": [{"uuid": "569bedd9-9452-4f31-aeae-2dd11fccbd2c"}]}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] validate_networks() for [('569bedd9-9452-4f31-aeae-2dd11fccbd2c', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for user 09e7674bd0a24feead88eb5b7338ae99 and project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:53:32 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d7c5986f-f60d-4dfa-9c19-900f91c0c7ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:53:32 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-7ed47eeb-9824-40de-93d9-51d24d352df7 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.844738 Apr 18 12:53:32 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 25/79] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:53:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:53:32 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-2888e9fa-75ee-4a6b-9e8f-772dc7f1ea4a tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:32 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-2888e9fa-75ee-4a6b-9e8f-772dc7f1ea4a tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:32 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-2888e9fa-75ee-4a6b-9e8f-772dc7f1ea4a tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:32 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-2888e9fa-75ee-4a6b-9e8f-772dc7f1ea4a tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 200 len: 1252 microversion: 2.1 time: 0.096224 Apr 18 12:53:32 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:32 2023] GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 1252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:53:35 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-27ea4ec1-ccd0-4bc8-a0bf-4fc59b437820 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d8b3250>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-642412010", "metadata": {"Type": "work"}}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:35 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-27ea4ec1-ccd0-4bc8-a0bf-4fc59b437820 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.889564 Apr 18 12:53:35 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 29/81] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 12:53:34 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 891 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 12:53:35 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-05dcd3a1-39c6-48cf-b718-aa5c6de639f7 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Calling method '.version_select at 0x7fcf0d05f490>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:35 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-05dcd3a1-39c6-48cf-b718-aa5c6de639f7 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07" status: 200 len: 349 microversion: 2.1 time: 0.079612 Apr 18 12:53:35 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 26/82] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 12:53:35 2023] GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07 => generated 349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:36 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-7c85d16d-7a3a-4792-84ee-586fcf18db08 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Calling method '.version_select at 0x7fcf0d8b1ab0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-7c85d16d-7a3a-4792-84ee-586fcf18db08 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07" status: 200 len: 349 microversion: 2.1 time: 0.166640 Apr 18 12:53:36 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 30/83] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 12:53:36 2023] GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07 => generated 349 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:36 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-0acab2a7-d93a-4c3f-b985-0b5b07f448cd tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Calling method '.version_select at 0x7fcf0d05d630>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:37 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc560a69f7412d9e07c7abfed885da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484b27326e0b478f89ff2a705df576d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:37 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-c92dca35-bcc8-4072-961a-72ef779cf328 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442" status: 200 len: 1490 microversion: 2.1 time: 0.582812 Apr 18 12:53:37 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 28/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:36 2023] GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442 => generated 1490 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:53:37 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-0acab2a7-d93a-4c3f-b985-0b5b07f448cd tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07" status: 202 len: 0 microversion: 2.1 time: 0.287464 Apr 18 12:53:37 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 27/85] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 12:53:36 2023] DELETE /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:53:37 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-bfe9983e-35cd-4cc8-bfb0-5ac8e5928b54 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Calling method '.version_select at 0x7fcf0d88edd0>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:37 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-bfe9983e-35cd-4cc8-bfb0-5ac8e5928b54 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] HTTP exception thrown: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. Apr 18 12:53:37 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-bfe9983e-35cd-4cc8-bfb0-5ac8e5928b54 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Request method failure captured: Apr 18 12:53:37 user devstack@n-api.service[61395]: request: GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07 HTTP/1.1 Apr 18 12:53:37 user devstack@n-api.service[61395]: Accept: application/json Apr 18 12:53:37 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 12:53:37 user devstack@n-api.service[61395]: Connection: close Apr 18 12:53:37 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 12:53:37 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 12:53:37 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 12:53:37 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 12:53:37 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpLOZkIUtor2_BP9iKBwuJPUr1hS5vwJq5Hz-1wK0BqemQUZECJ-kE0Tb__dyQX8UH1B7Wx4vthA6799lnu96JVBz4gDWMSZkLTzWokJ1xlyoaHzWbjZvmUNPSgvuNqO_RqT0TBeMxLDKY4coYW1GJaWAcpuN2t1VubAw7eonbU7tak Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Project-Id: c7c548fd77d546079e1061ae472da86e Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Project-Name: tempest-VolumesGetTestJSON-975843555 Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7c548fd77d546079e1061ae472da86e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c7c548fd77d546079e1061ae472da86e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7c548fd77d546079e1061ae472da86e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Tenant: tempest-VolumesGetTestJSON-975843555 Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Tenant-Id: c7c548fd77d546079e1061ae472da86e Apr 18 12:53:37 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-VolumesGetTestJSON-975843555 Apr 18 12:53:37 user devstack@n-api.service[61395]: X-User: tempest-VolumesGetTestJSON-975843555-project-member Apr 18 12:53:37 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 12:53:37 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 12:53:37 user devstack@n-api.service[61395]: X-User-Id: 13799e067f9247e1861c608d4ba73a00 Apr 18 12:53:37 user devstack@n-api.service[61395]: X-User-Name: tempest-VolumesGetTestJSON-975843555-project-member Apr 18 12:53:37 user devstack@n-api.service[61395]: method: Apr 18 12:53:37 user devstack@n-api.service[61395]: exception: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. Apr 18 12:53:37 user devstack@n-api.service[61395]: action_args: {'id': 'e64883de-5548-493b-8aba-a8390b97ce07'} Apr 18 12:53:37 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. (HTTP 404) (Request-ID: req-894de663-e93d-44c9-aa7d-99124c348c38) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. Apr 18 12:53:37 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:53:37 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-bfe9983e-35cd-4cc8-bfb0-5ac8e5928b54 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] Returning 404 to user: Volume e64883de-5548-493b-8aba-a8390b97ce07 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:53:37 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-bfe9983e-35cd-4cc8-bfb0-5ac8e5928b54 tempest-VolumesGetTestJSON-975843555 tempest-VolumesGetTestJSON-975843555-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07" status: 404 len: 109 microversion: 2.1 time: 0.044252 Apr 18 12:53:37 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 29/86] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 12:53:37 2023] GET /compute/v2.1/os-volumes/e64883de-5548-493b-8aba-a8390b97ce07 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:53:37 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:37 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-84bdc19e-fe10-4342-a383-4c892f519540 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1538 microversion: 2.1 time: 0.744369 Apr 18 12:53:37 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 31/87] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:37 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1538 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:53:37 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-4ca48dd7-f594-47b5-b930-ac3795eb2162 req-c5c98bfe-d52a-41bf-a57e-639b62ce4aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f245f166-497f-4543-b899-2898dbb4c250", "tag": "e6caa31c-326f-4b7d-8fe1-0dc97bc0053d"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:37 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4ca48dd7-f594-47b5-b930-ac3795eb2162 req-c5c98bfe-d52a-41bf-a57e-639b62ce4aaf service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:37 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4ca48dd7-f594-47b5-b930-ac3795eb2162 req-c5c98bfe-d52a-41bf-a57e-639b62ce4aaf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:37 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4ca48dd7-f594-47b5-b930-ac3795eb2162 req-c5c98bfe-d52a-41bf-a57e-639b62ce4aaf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:37 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-4ca48dd7-f594-47b5-b930-ac3795eb2162 req-c5c98bfe-d52a-41bf-a57e-639b62ce4aaf service nova] Creating event network-changed:e6caa31c-326f-4b7d-8fe1-0dc97bc0053d for instance f245f166-497f-4543-b899-2898dbb4c250 on user Apr 18 12:53:37 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-4ca48dd7-f594-47b5-b930-ac3795eb2162 req-c5c98bfe-d52a-41bf-a57e-639b62ce4aaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062403 Apr 18 12:53:37 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 28/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:38 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-055a80b6-11b2-4680-bb18-17f420271a57 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Action: 'create', calling method: .version_select at 0x7fcf0e4b9ab0>, body: {"keypair": {"name": "tempest-keypair-1699262919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi3MSruhJjnFpL/1ElnxGyU0wq3IXpZ42TCnvSnClL3JSTrMMZFyuzvyeSUa1Clq8uXzuBRnd/fkDGKeRker8e+i5M6sKpuHR6ZjE8R/0m2qitf5u6Cc/cH5CD+LdRlPw=="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:38 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-055a80b6-11b2-4680-bb18-17f420271a57 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:38 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-055a80b6-11b2-4680-bb18-17f420271a57 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for user d6575d954aca4737bb6e943143d434fb and project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:38 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-055a80b6-11b2-4680-bb18-17f420271a57 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.203906 Apr 18 12:53:38 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 30/89] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 12:53:38 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 12:53:39 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-842d77e8-4ab4-495c-85a8-c5e1062640ff tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d8b3eb0>, body: {"keypair": {"name": "tempest-keypair-954929054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Zd5rEBAI62CG5p9rIiM2Njl9wPpGsXVMn7JS5/t4jL3F9oe/j/e6dGtaNhygmL4pBbdw8U9YF2PfR78ySP5agDCrB3H34ew/mSS4PHRTJeqnZzAM+nXvxGzCEJrNC5Q=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:39 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-842d77e8-4ab4-495c-85a8-c5e1062640ff tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Getting quotas for project 67e0b5cb088a4562864d07104be87a9c. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:39 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-842d77e8-4ab4-495c-85a8-c5e1062640ff tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Getting quotas for user 28484fa4ad2e484f9a612941b5d6b335 and project 67e0b5cb088a4562864d07104be87a9c. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-842d77e8-4ab4-495c-85a8-c5e1062640ff tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.193541 Apr 18 12:53:39 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 32/90] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:53:39 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:40 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-87c72bf6-b9ec-426a-ae11-61d1b6218706 req-20ce81af-3b6d-44fa-9023-56fa2fb92653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f245f166-497f-4543-b899-2898dbb4c250", "name": "network-vif-plugged", "status": "completed", "tag": "e6caa31c-326f-4b7d-8fe1-0dc97bc0053d"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-87c72bf6-b9ec-426a-ae11-61d1b6218706 req-20ce81af-3b6d-44fa-9023-56fa2fb92653 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-87c72bf6-b9ec-426a-ae11-61d1b6218706 req-20ce81af-3b6d-44fa-9023-56fa2fb92653 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-87c72bf6-b9ec-426a-ae11-61d1b6218706 req-20ce81af-3b6d-44fa-9023-56fa2fb92653 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:40 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-87c72bf6-b9ec-426a-ae11-61d1b6218706 req-20ce81af-3b6d-44fa-9023-56fa2fb92653 service nova] Creating event network-vif-plugged:e6caa31c-326f-4b7d-8fe1-0dc97bc0053d for instance f245f166-497f-4543-b899-2898dbb4c250 on user Apr 18 12:53:40 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-87c72bf6-b9ec-426a-ae11-61d1b6218706 req-20ce81af-3b6d-44fa-9023-56fa2fb92653 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050716 Apr 18 12:53:40 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 29/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:41 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1472825304", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "a020502b-df71-4835-ae54-388fc6853530"}], "security_groups": [{"name": "tempest-securitygroup--1014894501"}], "key_name": "tempest-keypair-954929054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:41 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1683339916", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d2c52673-0449-495a-98f4-b55441b493d7"}], "security_groups": [{"name": "tempest-securitygroup--1143405884"}], "key_name": "tempest-keypair-1699262919", "user_data": "}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:41 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] validate_networks() for [('a020502b-df71-4835-ae54-388fc6853530', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:53:41 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] validate_networks() for [('d2c52673-0449-495a-98f4-b55441b493d7', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Getting quotas for project 67e0b5cb088a4562864d07104be87a9c. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Getting quotas for user 28484fa4ad2e484f9a612941b5d6b335 and project 67e0b5cb088a4562864d07104be87a9c. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:53:42 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-28763979-26e3-4e94-96c3-d08fae10cef1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.711714 Apr 18 12:53:42 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 31/92] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:53:41 2023] POST /compute/v2.1/servers => generated 404 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-21426ff6-bdd6-4ab3-84ee-7c7080fc21d5 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-21426ff6-bdd6-4ab3-84ee-7c7080fc21d5 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-21426ff6-bdd6-4ab3-84ee-7c7080fc21d5 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28484fa4ad2e484f9a612941b5d6b335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e0b5cb088a4562864d07104be87a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:42 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-21426ff6-bdd6-4ab3-84ee-7c7080fc21d5 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 200 len: 1239 microversion: 2.1 time: 0.059914 Apr 18 12:53:42 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 30/93] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:42 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for user d6575d954aca4737bb6e943143d434fb and project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:53:42 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-682833a8-bc53-4a55-b4a1-0eadc76a3deb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.770038 Apr 18 12:53:42 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 33/94] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 12:53:41 2023] POST /compute/v2.1/servers => generated 400 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5877ca91-e5b0-4c0b-aec3-4a968936a761 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5877ca91-e5b0-4c0b-aec3-4a968936a761 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-5877ca91-e5b0-4c0b-aec3-4a968936a761 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-5877ca91-e5b0-4c0b-aec3-4a968936a761 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:42 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-5877ca91-e5b0-4c0b-aec3-4a968936a761 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:42 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-5877ca91-e5b0-4c0b-aec3-4a968936a761 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 200 len: 1276 microversion: 2.20 time: 0.099168 Apr 18 12:53:42 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 32/95] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:53:42 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-79dde408-2649-4b2b-98a1-620b389721de req-028dc848-94ce-40de-b04d-d3037fa4fad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f245f166-497f-4543-b899-2898dbb4c250", "name": "network-vif-plugged", "status": "completed", "tag": "e6caa31c-326f-4b7d-8fe1-0dc97bc0053d"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-79dde408-2649-4b2b-98a1-620b389721de req-028dc848-94ce-40de-b04d-d3037fa4fad4 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-79dde408-2649-4b2b-98a1-620b389721de req-028dc848-94ce-40de-b04d-d3037fa4fad4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:42 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-79dde408-2649-4b2b-98a1-620b389721de req-028dc848-94ce-40de-b04d-d3037fa4fad4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:42 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-79dde408-2649-4b2b-98a1-620b389721de req-028dc848-94ce-40de-b04d-d3037fa4fad4 service nova] Creating event network-vif-plugged:e6caa31c-326f-4b7d-8fe1-0dc97bc0053d for instance f245f166-497f-4543-b899-2898dbb4c250 on user Apr 18 12:53:42 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-79dde408-2649-4b2b-98a1-620b389721de req-028dc848-94ce-40de-b04d-d3037fa4fad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Apr 18 12:53:42 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 34/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:43 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:43 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8172ca65-a334-41b9-99e2-802e7454db99 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1493 microversion: 2.1 time: 0.412543 Apr 18 12:53:43 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 31/97] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:42 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 12:53:46 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-e154c38b-2d4d-4baa-a6df-9a014347cb58 req-7824b6c8-09c3-4727-ae75-2dc47df366a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e154c38b-2d4d-4baa-a6df-9a014347cb58 req-7824b6c8-09c3-4727-ae75-2dc47df366a3 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e154c38b-2d4d-4baa-a6df-9a014347cb58 req-7824b6c8-09c3-4727-ae75-2dc47df366a3 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e154c38b-2d4d-4baa-a6df-9a014347cb58 req-7824b6c8-09c3-4727-ae75-2dc47df366a3 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:46 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-e154c38b-2d4d-4baa-a6df-9a014347cb58 req-7824b6c8-09c3-4727-ae75-2dc47df366a3 service nova] Creating event network-changed:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:53:46 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-e154c38b-2d4d-4baa-a6df-9a014347cb58 req-7824b6c8-09c3-4727-ae75-2dc47df366a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045062 Apr 18 12:53:46 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:47 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-6ae053de-1022-4156-a556-c8568ecc4fbe req-693768c3-d828-4074-a1f8-68a408f7302b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:47 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-6ae053de-1022-4156-a556-c8568ecc4fbe req-693768c3-d828-4074-a1f8-68a408f7302b service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:47 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-6ae053de-1022-4156-a556-c8568ecc4fbe req-693768c3-d828-4074-a1f8-68a408f7302b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:47 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-6ae053de-1022-4156-a556-c8568ecc4fbe req-693768c3-d828-4074-a1f8-68a408f7302b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:47 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-6ae053de-1022-4156-a556-c8568ecc4fbe req-693768c3-d828-4074-a1f8-68a408f7302b service nova] Creating event network-changed:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:53:47 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-6ae053de-1022-4156-a556-c8568ecc4fbe req-693768c3-d828-4074-a1f8-68a408f7302b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031956 Apr 18 12:53:47 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 35/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:49 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-cd533b5b-ae25-4b99-8742-84c172e7bb6e req-d4d66c1f-3aa8-4964-898a-85262be11c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "name": "network-vif-plugged", "status": "completed", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-cd533b5b-ae25-4b99-8742-84c172e7bb6e req-d4d66c1f-3aa8-4964-898a-85262be11c61 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-cd533b5b-ae25-4b99-8742-84c172e7bb6e req-d4d66c1f-3aa8-4964-898a-85262be11c61 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-cd533b5b-ae25-4b99-8742-84c172e7bb6e req-d4d66c1f-3aa8-4964-898a-85262be11c61 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:49 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-cd533b5b-ae25-4b99-8742-84c172e7bb6e req-d4d66c1f-3aa8-4964-898a-85262be11c61 service nova] Creating event network-vif-plugged:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:53:49 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-cd533b5b-ae25-4b99-8742-84c172e7bb6e req-d4d66c1f-3aa8-4964-898a-85262be11c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048278 Apr 18 12:53:49 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 32/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 12:53:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-da755b1f-3d4f-4147-b63e-9a07fe89f474 req-9cc3ce96-4366-4876-a394-e3d17016ac3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "name": "network-vif-plugged", "status": "completed", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-da755b1f-3d4f-4147-b63e-9a07fe89f474 req-9cc3ce96-4366-4876-a394-e3d17016ac3a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-da755b1f-3d4f-4147-b63e-9a07fe89f474 req-9cc3ce96-4366-4876-a394-e3d17016ac3a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-da755b1f-3d4f-4147-b63e-9a07fe89f474 req-9cc3ce96-4366-4876-a394-e3d17016ac3a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-da755b1f-3d4f-4147-b63e-9a07fe89f474 req-9cc3ce96-4366-4876-a394-e3d17016ac3a service nova] Creating event network-vif-plugged:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:53:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-da755b1f-3d4f-4147-b63e-9a07fe89f474 req-9cc3ce96-4366-4876-a394-e3d17016ac3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046407 Apr 18 12:53:50 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:51 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-5baf86d5-4a59-4bee-8955-3761092684de req-e235ebb4-483d-4f63-b527-f1db93c2501e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "name": "network-vif-plugged", "status": "completed", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:51 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5baf86d5-4a59-4bee-8955-3761092684de req-e235ebb4-483d-4f63-b527-f1db93c2501e service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:51 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5baf86d5-4a59-4bee-8955-3761092684de req-e235ebb4-483d-4f63-b527-f1db93c2501e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:51 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5baf86d5-4a59-4bee-8955-3761092684de req-e235ebb4-483d-4f63-b527-f1db93c2501e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:51 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-5baf86d5-4a59-4bee-8955-3761092684de req-e235ebb4-483d-4f63-b527-f1db93c2501e service nova] Creating event network-vif-plugged:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:53:51 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-5baf86d5-4a59-4bee-8955-3761092684de req-e235ebb4-483d-4f63-b527-f1db93c2501e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034666 Apr 18 12:53:51 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 36/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:53:52 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-469074c2-3e3b-4d7a-a49f-5501e5134316 req-bc841601-f5f5-4778-b77c-7e826bdbe809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "name": "network-vif-plugged", "status": "completed", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:53:52 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-469074c2-3e3b-4d7a-a49f-5501e5134316 req-bc841601-f5f5-4778-b77c-7e826bdbe809 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:52 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-469074c2-3e3b-4d7a-a49f-5501e5134316 req-bc841601-f5f5-4778-b77c-7e826bdbe809 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:52 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-469074c2-3e3b-4d7a-a49f-5501e5134316 req-bc841601-f5f5-4778-b77c-7e826bdbe809 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:52 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-469074c2-3e3b-4d7a-a49f-5501e5134316 req-bc841601-f5f5-4778-b77c-7e826bdbe809 service nova] Creating event network-vif-plugged:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:53:52 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-469074c2-3e3b-4d7a-a49f-5501e5134316 req-bc841601-f5f5-4778-b77c-7e826bdbe809 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061971 Apr 18 12:53:52 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=14 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:53:55 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c9e4b73b04177a12fefc47c8879c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100c45c0a3f42c89a9b63303871d801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:53:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-482ee66e-caee-494f-a423-c19d12813d3e tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 200 len: 1549 microversion: 2.1 time: 0.324322 Apr 18 12:53:55 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:53:55 2023] GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 1549 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=14 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=5 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=15 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:02 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37faecb47ed4c8e8dea21ee364164e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c47472a1a3e4494801cea627fe6cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f1b52851-b49b-4b51-96ec-cd2956a8e914 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114" status: 200 len: 1543 microversion: 2.1 time: 0.288235 Apr 18 12:54:02 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 37/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:01 2023] GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114 => generated 1543 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:10 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=8 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:10 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:10 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=16 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:10 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-029e220e-bb14-4227-8431-8bd96ecb10e4 tempest-TestShelveInstance-1700456325 tempest-TestShelveInstance-1700456325-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d05fbe0>, body: {"keypair": {"name": "tempest-TestShelveInstance-233993157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTYTgsjHrBjQQck3WqG0/VR22R2AY3Nreh0sK0DFEVafF4poZsUMT1Zrr4KhTdzuNAwqwftuhWAItwfdoPPFqgiXVHTRSp8vDP/qgFopAfQYi+RjmgFNf5rOUQ0b15aUQ=="}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:10 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-029e220e-bb14-4227-8431-8bd96ecb10e4 tempest-TestShelveInstance-1700456325 tempest-TestShelveInstance-1700456325-project-member] Getting quotas for project 29daec23a56d4ff5b789593e9decc8a7. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:54:10 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-029e220e-bb14-4227-8431-8bd96ecb10e4 tempest-TestShelveInstance-1700456325 tempest-TestShelveInstance-1700456325-project-member] Getting quotas for user 3cf4b2291f7a4a9ba5db6ecde8a5223a and project 29daec23a56d4ff5b789593e9decc8a7. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:54:10 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-029e220e-bb14-4227-8431-8bd96ecb10e4 tempest-TestShelveInstance-1700456325 tempest-TestShelveInstance-1700456325-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.280013 Apr 18 12:54:10 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 34/106] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:54:10 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:13 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-84bc055d-8ec2-4e24-b501-7305ee7a9131 tempest-TestShelveInstance-1700456325 tempest-TestShelveInstance-1700456325-project-member] Calling method '.version_select at 0x7fcf0cf19a20>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:13 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:13 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=18 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:13 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-84bc055d-8ec2-4e24-b501-7305ee7a9131 tempest-TestShelveInstance-1700456325 tempest-TestShelveInstance-1700456325-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-233993157" status: 202 len: 0 microversion: 2.1 time: 0.027073 Apr 18 12:54:13 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 18 12:54:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-233993157 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=5 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:23 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-157d20cd-e0d4-41d8-b4e6-cde89011a8ba tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 200 len: 1537 microversion: 2.1 time: 0.239082 Apr 18 12:54:23 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 38/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:22 2023] GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:32 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28484fa4ad2e484f9a612941b5d6b335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e0b5cb088a4562864d07104be87a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:32 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-59f8829f-0249-40e7-b176-780c73f5081b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 200 len: 1553 microversion: 2.1 time: 0.212147 Apr 18 12:54:32 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 35/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:32 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:33 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:33 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:33 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:33 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-1cd1f5d5-1899-44c0-b2c8-ac6d5feb2630 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 200 len: 1588 microversion: 2.20 time: 0.239168 Apr 18 12:54:33 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 37/110] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:54:32 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 1588 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:37 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:38 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-dd5e5942-cab9-42dd-b387-19f1e569b653 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.196362 Apr 18 12:54:38 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 39/111] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 12:54:37 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77/os-interface => generated 283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:38 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:54:39 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-113ec0c4-f71b-475b-9f1a-724b2a9dfc54 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442" status: 204 len: 0 microversion: 2.1 time: 0.404204 Apr 18 12:54:39 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 36/112] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:54:38 2023] DELETE /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:39 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-b277ff74-66fd-44bd-9fdd-76c837994bfd req-cefb439a-feed-4c17-8626-632de0a8b808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189acda6-7b91-4a07-91bc-115f8070a442", "name": "network-vif-unplugged", "status": "completed", "tag": "3125f737-5918-4f42-a29b-51b3f8a5f57c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b277ff74-66fd-44bd-9fdd-76c837994bfd req-cefb439a-feed-4c17-8626-632de0a8b808 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b277ff74-66fd-44bd-9fdd-76c837994bfd req-cefb439a-feed-4c17-8626-632de0a8b808 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b277ff74-66fd-44bd-9fdd-76c837994bfd req-cefb439a-feed-4c17-8626-632de0a8b808 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-b277ff74-66fd-44bd-9fdd-76c837994bfd req-cefb439a-feed-4c17-8626-632de0a8b808 service nova] Creating event network-vif-unplugged:3125f737-5918-4f42-a29b-51b3f8a5f57c for instance 189acda6-7b91-4a07-91bc-115f8070a442 on user Apr 18 12:54:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-b277ff74-66fd-44bd-9fdd-76c837994bfd req-cefb439a-feed-4c17-8626-632de0a8b808 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032951 Apr 18 12:54:39 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 40/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:39 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:39 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc560a69f7412d9e07c7abfed885da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484b27326e0b478f89ff2a705df576d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:39 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-92df87a2-b710-4fd2-a8f4-d26442b131e8 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442" status: 200 len: 1496 microversion: 2.1 time: 0.423776 Apr 18 12:54:39 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:39 2023] GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442 => generated 1496 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:40 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:40 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-fca24514-aaa9-4f1d-a0f7-6b4b4443926b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1538 microversion: 2.1 time: 0.581787 Apr 18 12:54:40 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 37/115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:39 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1538 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:40 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:40 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f7d0d27e-e8e2-4632-8559-e6f3e1ecb8a0 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1538 microversion: 2.1 time: 0.147190 Apr 18 12:54:40 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 41/116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:40 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1538 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:40 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-34e0cced-d6e3-411e-9fe0-66d891635bd3 req-2911cb6d-ded4-4284-b653-93347d23ff8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189acda6-7b91-4a07-91bc-115f8070a442", "name": "network-vif-deleted", "tag": "3125f737-5918-4f42-a29b-51b3f8a5f57c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-34e0cced-d6e3-411e-9fe0-66d891635bd3 req-2911cb6d-ded4-4284-b653-93347d23ff8e service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-34e0cced-d6e3-411e-9fe0-66d891635bd3 req-2911cb6d-ded4-4284-b653-93347d23ff8e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-34e0cced-d6e3-411e-9fe0-66d891635bd3 req-2911cb6d-ded4-4284-b653-93347d23ff8e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:40 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-34e0cced-d6e3-411e-9fe0-66d891635bd3 req-2911cb6d-ded4-4284-b653-93347d23ff8e service nova] Creating event network-vif-deleted:3125f737-5918-4f42-a29b-51b3f8a5f57c for instance 189acda6-7b91-4a07-91bc-115f8070a442 on user Apr 18 12:54:40 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-34e0cced-d6e3-411e-9fe0-66d891635bd3 req-2911cb6d-ded4-4284-b653-93347d23ff8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044056 Apr 18 12:54:40 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:41 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}, {"server_uuid": "189acda6-7b91-4a07-91bc-115f8070a442", "name": "network-vif-plugged", "status": "completed", "tag": "3125f737-5918-4f42-a29b-51b3f8a5f57c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] Creating event network-changed:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 12:54:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] Creating event network-vif-plugged:3125f737-5918-4f42-a29b-51b3f8a5f57c for instance 189acda6-7b91-4a07-91bc-115f8070a442 on user Apr 18 12:54:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-79053572-9682-4369-bc14-4e62604e8274 req-6d3b59c7-057f-4598-af28-608e19ab47d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034074 Apr 18 12:54:41 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 38/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1992931038", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "a065d353-7a7d-475d-b1f0-65db1dd7dfa8"}]}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] validate_networks() for [('a065d353-7a7d-475d-b1f0-65db1dd7dfa8', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Getting quotas for project a76859b643e84f8f83b6092498f0f2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Getting quotas for user decaeb6e67f94c7a87fb782e089621f9 and project a76859b643e84f8f83b6092498f0f2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:54:43 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:54:44 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-b668bbfd-0401-4a1d-a0c1-7e4e2022c122 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.770161 Apr 18 12:54:44 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 42/119] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:54:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:54:44 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c0c19576-284d-42e1-96b7-47677d011918 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:44 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-c0c19576-284d-42e1-96b7-47677d011918 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:44 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-c0c19576-284d-42e1-96b7-47677d011918 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:44 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-c0c19576-284d-42e1-96b7-47677d011918 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 200 len: 1211 microversion: 2.1 time: 0.074678 Apr 18 12:54:44 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:44 2023] GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 1211 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 12:54:46 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-93ff650b-4f71-4166-9a8d-466b3f8f0020 req-05120b5f-1532-450e-bdfe-79260ecc0db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01aeff8-a91d-477a-a530-4147ce9670fd", "tag": "17378aa8-b1fb-47fc-8780-eefa30699267"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-93ff650b-4f71-4166-9a8d-466b3f8f0020 req-05120b5f-1532-450e-bdfe-79260ecc0db5 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-93ff650b-4f71-4166-9a8d-466b3f8f0020 req-05120b5f-1532-450e-bdfe-79260ecc0db5 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:46 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-93ff650b-4f71-4166-9a8d-466b3f8f0020 req-05120b5f-1532-450e-bdfe-79260ecc0db5 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:46 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-93ff650b-4f71-4166-9a8d-466b3f8f0020 req-05120b5f-1532-450e-bdfe-79260ecc0db5 service nova] Creating event network-changed:17378aa8-b1fb-47fc-8780-eefa30699267 for instance d01aeff8-a91d-477a-a530-4147ce9670fd on user Apr 18 12:54:46 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-93ff650b-4f71-4166-9a8d-466b3f8f0020 req-05120b5f-1532-450e-bdfe-79260ecc0db5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030094 Apr 18 12:54:46 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:48 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-ba1471c2-b864-400c-b435-878dd810702f req-519b0c9e-f0ae-412c-a74a-10152932afcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01aeff8-a91d-477a-a530-4147ce9670fd", "name": "network-vif-plugged", "status": "completed", "tag": "17378aa8-b1fb-47fc-8780-eefa30699267"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-ba1471c2-b864-400c-b435-878dd810702f req-519b0c9e-f0ae-412c-a74a-10152932afcc service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-ba1471c2-b864-400c-b435-878dd810702f req-519b0c9e-f0ae-412c-a74a-10152932afcc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-ba1471c2-b864-400c-b435-878dd810702f req-519b0c9e-f0ae-412c-a74a-10152932afcc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:48 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-ba1471c2-b864-400c-b435-878dd810702f req-519b0c9e-f0ae-412c-a74a-10152932afcc service nova] Creating event network-vif-plugged:17378aa8-b1fb-47fc-8780-eefa30699267 for instance d01aeff8-a91d-477a-a530-4147ce9670fd on user Apr 18 12:54:48 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-ba1471c2-b864-400c-b435-878dd810702f req-519b0c9e-f0ae-412c-a74a-10152932afcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027073 Apr 18 12:54:48 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 43/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-491d7f84-f054-409b-b237-da594e712399 req-52189023-ccbf-474a-8862-360fea157473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01aeff8-a91d-477a-a530-4147ce9670fd", "name": "network-vif-plugged", "status": "completed", "tag": "17378aa8-b1fb-47fc-8780-eefa30699267"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-491d7f84-f054-409b-b237-da594e712399 req-52189023-ccbf-474a-8862-360fea157473 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-491d7f84-f054-409b-b237-da594e712399 req-52189023-ccbf-474a-8862-360fea157473 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-491d7f84-f054-409b-b237-da594e712399 req-52189023-ccbf-474a-8862-360fea157473 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-491d7f84-f054-409b-b237-da594e712399 req-52189023-ccbf-474a-8862-360fea157473 service nova] Creating event network-vif-plugged:17378aa8-b1fb-47fc-8780-eefa30699267 for instance d01aeff8-a91d-477a-a530-4147ce9670fd on user Apr 18 12:54:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-491d7f84-f054-409b-b237-da594e712399 req-52189023-ccbf-474a-8862-360fea157473 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028195 Apr 18 12:54:50 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 41/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:55 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c8c680df-6d30-47a8-b745-b92aa37de868 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.155117 Apr 18 12:54:55 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 40/124] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 12:54:55 2023] GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff/os-interface => generated 283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:56 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:56 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:56 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-76e59e12-e55c-42c2-ab34-ab58d5cd3712 req-b7c49ac1-2223-4d7a-aa41-65d4c35eda70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:56 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-76e59e12-e55c-42c2-ab34-ab58d5cd3712 req-b7c49ac1-2223-4d7a-aa41-65d4c35eda70 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:56 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-76e59e12-e55c-42c2-ab34-ab58d5cd3712 req-b7c49ac1-2223-4d7a-aa41-65d4c35eda70 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:56 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-76e59e12-e55c-42c2-ab34-ab58d5cd3712 req-b7c49ac1-2223-4d7a-aa41-65d4c35eda70 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:56 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-76e59e12-e55c-42c2-ab34-ab58d5cd3712 req-b7c49ac1-2223-4d7a-aa41-65d4c35eda70 service nova] Creating event network-changed:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:54:56 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-76e59e12-e55c-42c2-ab34-ab58d5cd3712 req-b7c49ac1-2223-4d7a-aa41-65d4c35eda70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035311 Apr 18 12:54:56 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 44/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:58 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Going to try to terminate instance {{(pid=61395) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:54:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-3238ea70-d3ce-4910-9b27-db0aed397fa7 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 204 len: 0 microversion: 2.1 time: 0.402751 Apr 18 12:54:58 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 42/126] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:54:58 2023] DELETE /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:59 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-b081b1aa-9623-411c-b712-8db707ed7cdb req-619a996e-b89c-4228-8d50-4c066b751b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "name": "network-vif-unplugged", "status": "completed", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:54:59 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b081b1aa-9623-411c-b712-8db707ed7cdb req-619a996e-b89c-4228-8d50-4c066b751b43 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:54:59 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b081b1aa-9623-411c-b712-8db707ed7cdb req-619a996e-b89c-4228-8d50-4c066b751b43 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:54:59 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b081b1aa-9623-411c-b712-8db707ed7cdb req-619a996e-b89c-4228-8d50-4c066b751b43 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:54:59 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c9e4b73b04177a12fefc47c8879c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f100c45c0a3f42c89a9b63303871d801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:54:59 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-af1f1d64-5f6f-42f0-aa93-29e1a44b3e1a tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 200 len: 1674 microversion: 2.1 time: 0.482777 Apr 18 12:54:59 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 41/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:54:58 2023] GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 1674 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:54:59 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-b081b1aa-9623-411c-b712-8db707ed7cdb req-619a996e-b89c-4228-8d50-4c066b751b43 service nova] Creating event network-vif-unplugged:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:54:59 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-b081b1aa-9623-411c-b712-8db707ed7cdb req-619a996e-b89c-4228-8d50-4c066b751b43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.319795 Apr 18 12:54:59 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 45/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:54:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:00 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-f26f4c8f-b5c1-45e6-8c9e-8e2728798f5c req-a9ea81a4-74ea-4496-9739-2c243006940b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "name": "network-vif-deleted", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:00 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-f26f4c8f-b5c1-45e6-8c9e-8e2728798f5c req-a9ea81a4-74ea-4496-9739-2c243006940b service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:00 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-f26f4c8f-b5c1-45e6-8c9e-8e2728798f5c req-a9ea81a4-74ea-4496-9739-2c243006940b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:00 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-f26f4c8f-b5c1-45e6-8c9e-8e2728798f5c req-a9ea81a4-74ea-4496-9739-2c243006940b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:00 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-f26f4c8f-b5c1-45e6-8c9e-8e2728798f5c req-a9ea81a4-74ea-4496-9739-2c243006940b service nova] Creating event network-vif-deleted:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:55:00 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-f26f4c8f-b5c1-45e6-8c9e-8e2728798f5c req-a9ea81a4-74ea-4496-9739-2c243006940b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034297 Apr 18 12:55:00 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:01 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-d14b076e-364f-4b92-bc8c-93b691f43799 req-7488e5f5-124b-4407-bca6-62fae46584e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ae6a4-b3d8-4733-bf29-e9efa950baff", "name": "network-vif-plugged", "status": "completed", "tag": "50d7ba99-21c5-4cbb-b145-b1c04f19b6c1"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:01 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-d14b076e-364f-4b92-bc8c-93b691f43799 req-7488e5f5-124b-4407-bca6-62fae46584e6 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:01 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-d14b076e-364f-4b92-bc8c-93b691f43799 req-7488e5f5-124b-4407-bca6-62fae46584e6 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:01 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-d14b076e-364f-4b92-bc8c-93b691f43799 req-7488e5f5-124b-4407-bca6-62fae46584e6 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:01 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-d14b076e-364f-4b92-bc8c-93b691f43799 req-7488e5f5-124b-4407-bca6-62fae46584e6 service nova] Creating event network-vif-plugged:50d7ba99-21c5-4cbb-b145-b1c04f19b6c1 for instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff on user Apr 18 12:55:01 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-d14b076e-364f-4b92-bc8c-93b691f43799 req-7488e5f5-124b-4407-bca6-62fae46584e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030222 Apr 18 12:55:01 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 42/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-2cc2fae9-de0c-4a90-a392-5eaeb15f9d34 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.237145 Apr 18 12:55:02 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 46/131] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 12:55:02 2023] GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114/os-interface => generated 282 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:03 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-5a4fe262-59a5-4525-87c0-999dc2061f96 req-c3486070-6703-4dc4-a7be-ee0265136bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:03 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:03 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-5a4fe262-59a5-4525-87c0-999dc2061f96 req-c3486070-6703-4dc4-a7be-ee0265136bec service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:03 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-5a4fe262-59a5-4525-87c0-999dc2061f96 req-c3486070-6703-4dc4-a7be-ee0265136bec service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:03 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-5a4fe262-59a5-4525-87c0-999dc2061f96 req-c3486070-6703-4dc4-a7be-ee0265136bec service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:03 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:03 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-5a4fe262-59a5-4525-87c0-999dc2061f96 req-c3486070-6703-4dc4-a7be-ee0265136bec service nova] Creating event network-changed:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:55:03 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-5a4fe262-59a5-4525-87c0-999dc2061f96 req-c3486070-6703-4dc4-a7be-ee0265136bec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043629 Apr 18 12:55:03 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:04 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1260358357", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "bcaa4fb9-53c1-43e9-b346-002b19ab58ad"}]}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:04 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:04 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] validate_networks() for [('bcaa4fb9-53c1-43e9-b346-002b19ab58ad', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Getting quotas for project 4c47472a1a3e4494801cea627fe6cb66. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Getting quotas for user a37faecb47ed4c8e8dea21ee364164e5 and project 4c47472a1a3e4494801cea627fe6cb66. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:55:05 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:55:05 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-1c35fd1b-0dc8-4063-9e39-ffb5ff4d8613 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.551621 Apr 18 12:55:05 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 43/133] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:55:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:55:05 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-28522927-3422-4277-8788-c29d9dbcd82e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:05 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-28522927-3422-4277-8788-c29d9dbcd82e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:05 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-28522927-3422-4277-8788-c29d9dbcd82e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37faecb47ed4c8e8dea21ee364164e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c47472a1a3e4494801cea627fe6cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:05 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-28522927-3422-4277-8788-c29d9dbcd82e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02" status: 200 len: 1212 microversion: 2.1 time: 0.082563 Apr 18 12:55:05 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 47/134] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:05 2023] GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:07 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-910b604f-bd9e-4609-b0c3-1be762afc102 req-a133c894-5996-42ba-9283-232840369c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68780c76-c582-470e-81ad-6be81909ae02", "tag": "48d76b52-3745-4d28-a4ae-a8912c42500e"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:07 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-910b604f-bd9e-4609-b0c3-1be762afc102 req-a133c894-5996-42ba-9283-232840369c2b service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:07 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-910b604f-bd9e-4609-b0c3-1be762afc102 req-a133c894-5996-42ba-9283-232840369c2b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:07 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-910b604f-bd9e-4609-b0c3-1be762afc102 req-a133c894-5996-42ba-9283-232840369c2b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:07 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-910b604f-bd9e-4609-b0c3-1be762afc102 req-a133c894-5996-42ba-9283-232840369c2b service nova] Creating event network-changed:48d76b52-3745-4d28-a4ae-a8912c42500e for instance 68780c76-c582-470e-81ad-6be81909ae02 on user Apr 18 12:55:07 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-910b604f-bd9e-4609-b0c3-1be762afc102 req-a133c894-5996-42ba-9283-232840369c2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055778 Apr 18 12:55:07 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:09 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-fbc2a788-0fa5-41f5-818e-f6241d2274e0 req-88ec99b3-d5bd-4c48-bff5-56d7dc63d876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68780c76-c582-470e-81ad-6be81909ae02", "name": "network-vif-plugged", "status": "completed", "tag": "48d76b52-3745-4d28-a4ae-a8912c42500e"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-fbc2a788-0fa5-41f5-818e-f6241d2274e0 req-88ec99b3-d5bd-4c48-bff5-56d7dc63d876 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-fbc2a788-0fa5-41f5-818e-f6241d2274e0 req-88ec99b3-d5bd-4c48-bff5-56d7dc63d876 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-fbc2a788-0fa5-41f5-818e-f6241d2274e0 req-88ec99b3-d5bd-4c48-bff5-56d7dc63d876 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-fbc2a788-0fa5-41f5-818e-f6241d2274e0 req-88ec99b3-d5bd-4c48-bff5-56d7dc63d876 service nova] Creating event network-vif-plugged:48d76b52-3745-4d28-a4ae-a8912c42500e for instance 68780c76-c582-470e-81ad-6be81909ae02 on user Apr 18 12:55:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-fbc2a788-0fa5-41f5-818e-f6241d2274e0 req-88ec99b3-d5bd-4c48-bff5-56d7dc63d876 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041223 Apr 18 12:55:09 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 44/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:11 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-7eacc78d-36cc-4c80-8966-fd3af7261d10 req-f14c8428-3005-458a-85ca-d8dec02d5c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68780c76-c582-470e-81ad-6be81909ae02", "name": "network-vif-plugged", "status": "completed", "tag": "48d76b52-3745-4d28-a4ae-a8912c42500e"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:11 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7eacc78d-36cc-4c80-8966-fd3af7261d10 req-f14c8428-3005-458a-85ca-d8dec02d5c1f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7eacc78d-36cc-4c80-8966-fd3af7261d10 req-f14c8428-3005-458a-85ca-d8dec02d5c1f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7eacc78d-36cc-4c80-8966-fd3af7261d10 req-f14c8428-3005-458a-85ca-d8dec02d5c1f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:11 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=25 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-7eacc78d-36cc-4c80-8966-fd3af7261d10 req-f14c8428-3005-458a-85ca-d8dec02d5c1f service nova] Creating event network-vif-plugged:48d76b52-3745-4d28-a4ae-a8912c42500e for instance 68780c76-c582-470e-81ad-6be81909ae02 on user Apr 18 12:55:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-7eacc78d-36cc-4c80-8966-fd3af7261d10 req-f14c8428-3005-458a-85ca-d8dec02d5c1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 Apr 18 12:55:11 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:23 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:23 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-20525c2e-1246-4173-bb69-cdcd5f5132c8 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 200 len: 1537 microversion: 2.1 time: 0.299398 Apr 18 12:55:23 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:23 2023] GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=6 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Searching by: {'deleted': False, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780'} {{(pid=61393) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:23 user devstack@n-api.service[61393]: DEBUG nova.compute.multi_cell_list [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61393) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 12:55:23 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-9a159897-2f19-4eb5-8ee3-fe3d80fe5182 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.193721 Apr 18 12:55:23 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 45/139] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 12:55:23 2023] GET /compute/v2.1/servers => generated 340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:23 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-0da307d3-bf91-4406-a763-e14828f470bf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 200 len: 1537 microversion: 2.1 time: 0.238941 Apr 18 12:55:23 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 49/140] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:23 2023] GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:25 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Going to try to terminate instance {{(pid=61395) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:55:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-4e9a516b-3c5e-4569-b764-2caad2ce0e0c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 204 len: 0 microversion: 2.1 time: 0.115681 Apr 18 12:55:25 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:55:25 2023] DELETE /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-ed5dc7c5-30cb-40de-b448-31819027ecbc req-41d34dcd-c88c-4765-8d9c-22acb984fea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f245f166-497f-4543-b899-2898dbb4c250", "name": "network-vif-unplugged", "status": "completed", "tag": "e6caa31c-326f-4b7d-8fe1-0dc97bc0053d"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-ed5dc7c5-30cb-40de-b448-31819027ecbc req-41d34dcd-c88c-4765-8d9c-22acb984fea7 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-ed5dc7c5-30cb-40de-b448-31819027ecbc req-41d34dcd-c88c-4765-8d9c-22acb984fea7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-ed5dc7c5-30cb-40de-b448-31819027ecbc req-41d34dcd-c88c-4765-8d9c-22acb984fea7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-ed5dc7c5-30cb-40de-b448-31819027ecbc req-41d34dcd-c88c-4765-8d9c-22acb984fea7 service nova] Creating event network-vif-unplugged:e6caa31c-326f-4b7d-8fe1-0dc97bc0053d for instance f245f166-497f-4543-b899-2898dbb4c250 on user Apr 18 12:55:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-ed5dc7c5-30cb-40de-b448-31819027ecbc req-41d34dcd-c88c-4765-8d9c-22acb984fea7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039893 Apr 18 12:55:25 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 50/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:26 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:26 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ea84d565-371a-449b-b4ee-fae69c962c18 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 200 len: 1543 microversion: 2.1 time: 0.491924 Apr 18 12:55:26 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 46/143] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:25 2023] GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 1543 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:26 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-c6624b42-4475-4cf6-9fd1-5fd9a7a54b80 req-e44ca75c-69a2-4c3d-8ac4-d546274bde95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f245f166-497f-4543-b899-2898dbb4c250", "name": "network-vif-deleted", "tag": "e6caa31c-326f-4b7d-8fe1-0dc97bc0053d"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c6624b42-4475-4cf6-9fd1-5fd9a7a54b80 req-e44ca75c-69a2-4c3d-8ac4-d546274bde95 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c6624b42-4475-4cf6-9fd1-5fd9a7a54b80 req-e44ca75c-69a2-4c3d-8ac4-d546274bde95 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c6624b42-4475-4cf6-9fd1-5fd9a7a54b80 req-e44ca75c-69a2-4c3d-8ac4-d546274bde95 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:26 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-c6624b42-4475-4cf6-9fd1-5fd9a7a54b80 req-e44ca75c-69a2-4c3d-8ac4-d546274bde95 service nova] Creating event network-vif-deleted:e6caa31c-326f-4b7d-8fe1-0dc97bc0053d for instance f245f166-497f-4543-b899-2898dbb4c250 on user Apr 18 12:55:26 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-c6624b42-4475-4cf6-9fd1-5fd9a7a54b80 req-e44ca75c-69a2-4c3d-8ac4-d546274bde95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030515 Apr 18 12:55:26 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:27 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-93db54c4-d02a-4d12-9ef9-f0919b1f4df8 req-c5b47558-c1de-4264-8b5d-effda0dd04af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f245f166-497f-4543-b899-2898dbb4c250", "name": "network-vif-plugged", "status": "completed", "tag": "e6caa31c-326f-4b7d-8fe1-0dc97bc0053d"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:27 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-93db54c4-d02a-4d12-9ef9-f0919b1f4df8 req-c5b47558-c1de-4264-8b5d-effda0dd04af service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:27 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-93db54c4-d02a-4d12-9ef9-f0919b1f4df8 req-c5b47558-c1de-4264-8b5d-effda0dd04af service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:27 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-93db54c4-d02a-4d12-9ef9-f0919b1f4df8 req-c5b47558-c1de-4264-8b5d-effda0dd04af service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:27 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-93db54c4-d02a-4d12-9ef9-f0919b1f4df8 req-c5b47558-c1de-4264-8b5d-effda0dd04af service nova] Creating event network-vif-plugged:e6caa31c-326f-4b7d-8fe1-0dc97bc0053d for instance f245f166-497f-4543-b899-2898dbb4c250 on user Apr 18 12:55:27 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-93db54c4-d02a-4d12-9ef9-f0919b1f4df8 req-c5b47558-c1de-4264-8b5d-effda0dd04af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030812 Apr 18 12:55:27 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 51/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] [instance: 189acda6-7b91-4a07-91bc-115f8070a442] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:29 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] HTTP exception thrown: Instance 189acda6-7b91-4a07-91bc-115f8070a442 could not be found. Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Request method failure captured: Apr 18 12:55:29 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442 HTTP/1.1 Apr 18 12:55:29 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:55:29 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:55:29 user devstack@n-api.service[61393]: Connection: close Apr 18 12:55:29 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:55:29 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:55:29 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:55:29 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:55:29 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpKan0PyriuASduVVgtfj0Cak20JeHsy4tMWBmyzJ0sKu5mmgR-x7MbdtO1rOsBd3yZa5JvCFifMSogehhra6a96JukbDAm28fA7XIWnVqucbhsQZFgZqkFEwKkYWZj1ecqqOoPSHsYLTFy3QZYY2uBTd9ONhtkWz-yoYAr8kkAn4dY Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Project-Id: 484b27326e0b478f89ff2a705df576d0 Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Project-Name: tempest-DeleteServersTestJSON-1240551672 Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/484b27326e0b478f89ff2a705df576d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/484b27326e0b478f89ff2a705df576d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/484b27326e0b478f89ff2a705df576d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Tenant: tempest-DeleteServersTestJSON-1240551672 Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Tenant-Id: 484b27326e0b478f89ff2a705df576d0 Apr 18 12:55:29 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-DeleteServersTestJSON-1240551672 Apr 18 12:55:29 user devstack@n-api.service[61393]: X-User: tempest-DeleteServersTestJSON-1240551672-project-member Apr 18 12:55:29 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:55:29 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:55:29 user devstack@n-api.service[61393]: X-User-Id: d6bc560a69f7412d9e07c7abfed885da Apr 18 12:55:29 user devstack@n-api.service[61393]: X-User-Name: tempest-DeleteServersTestJSON-1240551672-project-member Apr 18 12:55:29 user devstack@n-api.service[61393]: method: > Apr 18 12:55:29 user devstack@n-api.service[61393]: exception: Instance 189acda6-7b91-4a07-91bc-115f8070a442 could not be found. Apr 18 12:55:29 user devstack@n-api.service[61393]: action_args: {'id': '189acda6-7b91-4a07-91bc-115f8070a442'} Apr 18 12:55:29 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 189acda6-7b91-4a07-91bc-115f8070a442 could not be found. Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 189acda6-7b91-4a07-91bc-115f8070a442 could not be found. Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 189acda6-7b91-4a07-91bc-115f8070a442 could not be found. Apr 18 12:55:29 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:29 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] Returning 404 to user: Instance 189acda6-7b91-4a07-91bc-115f8070a442 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:55:29 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-43a35a46-d0ec-4976-9c45-b5386a0552a3 tempest-DeleteServersTestJSON-1240551672 tempest-DeleteServersTestJSON-1240551672-project-member] 10.0.0.210 "GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442" status: 404 len: 111 microversion: 2.1 time: 0.037351 Apr 18 12:55:29 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 47/146] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:29 2023] GET /compute/v2.1/servers/189acda6-7b91-4a07-91bc-115f8070a442 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:30 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:30 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-64b03a07-6860-4ac1-a05d-3ba096702a7e tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.224074 Apr 18 12:55:30 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:30 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:30 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-26df0d63-2c7d-4226-b3f8-521098b3880f tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.227524 Apr 18 12:55:30 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 52/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:30 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:33 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-139e8e2c-943b-4102-87fc-6455d9fff747 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.161496 Apr 18 12:55:33 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 12:55:32 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08/os-interface => generated 282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:33 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-f33349b5-a5c6-40d5-b554-017b0133b097 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.200819 Apr 18 12:55:33 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 50/150] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 12:55:33 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc/os-interface => generated 283 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:55:33 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-e5616752-8233-40df-ab22-c5ceeb6fd192 req-07d65112-3540-4760-a42a-e7c9a27731a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-e5616752-8233-40df-ab22-c5ceeb6fd192 req-07d65112-3540-4760-a42a-e7c9a27731a5 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-e5616752-8233-40df-ab22-c5ceeb6fd192 req-07d65112-3540-4760-a42a-e7c9a27731a5 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-e5616752-8233-40df-ab22-c5ceeb6fd192 req-07d65112-3540-4760-a42a-e7c9a27731a5 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:33 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-e5616752-8233-40df-ab22-c5ceeb6fd192 req-07d65112-3540-4760-a42a-e7c9a27731a5 service nova] Creating event network-changed:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:55:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-e5616752-8233-40df-ab22-c5ceeb6fd192 req-07d65112-3540-4760-a42a-e7c9a27731a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033797 Apr 18 12:55:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 53/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-18955786"}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-8d48541b-5e1f-4d8a-890c-f475a03e2879 req-488c9232-fc71-40af-91d3-81b1956f3b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8d48541b-5e1f-4d8a-890c-f475a03e2879 req-488c9232-fc71-40af-91d3-81b1956f3b43 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8d48541b-5e1f-4d8a-890c-f475a03e2879 req-488c9232-fc71-40af-91d3-81b1956f3b43 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8d48541b-5e1f-4d8a-890c-f475a03e2879 req-488c9232-fc71-40af-91d3-81b1956f3b43 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-1e1446b7-047a-4818-b92a-8cf669ecef8f tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 200 len: 1494 microversion: 2.1 time: 0.573888 Apr 18 12:55:34 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 51/152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:34 2023] GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 1494 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-8d48541b-5e1f-4d8a-890c-f475a03e2879 req-488c9232-fc71-40af-91d3-81b1956f3b43 service nova] Creating event network-changed:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:55:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-8d48541b-5e1f-4d8a-890c-f475a03e2879 req-488c9232-fc71-40af-91d3-81b1956f3b43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053926 Apr 18 12:55:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 54/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:34 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:34 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8221437f-3998-4367-9de4-d7f5bf439da1 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08/action" status: 202 len: 0 microversion: 2.1 time: 0.863888 Apr 18 12:55:34 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 49/154] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 12:55:34 2023] POST /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 12:55:34 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b245733b-9e7b-46f4-8b5f-3f8a69340595 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc/ips" status: 200 len: 110 microversion: 2.20 time: 0.042169 Apr 18 12:55:34 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 52/155] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 12:55:34 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc/ips => generated 110 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:55:34 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d956745d-c9d4-4bc0-a79b-cb612ca76665 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '.version_select at 0x7fcf0cf644c0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-d956745d-c9d4-4bc0-a79b-cb612ca76665 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930" status: 200 len: 1609 microversion: 2.1 time: 0.048500 Apr 18 12:55:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 55/156] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 12:55:34 2023] GET /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930 => generated 1609 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:36 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:55:36 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-60ad0a66-4f25-4039-8646-e2666a59a645 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 204 len: 0 microversion: 2.20 time: 0.111156 Apr 18 12:55:36 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 50/157] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 12:55:36 2023] DELETE /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:36 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:36 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-30f2574e-dd56-4032-8689-f7e363fa3473 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 200 len: 1713 microversion: 2.20 time: 0.163586 Apr 18 12:55:36 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 53/158] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:55:36 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:55:36 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-38620556-60e0-4b18-b576-c43f2c28a3db req-8a3173f2-7a5f-41dc-871b-5e0617f5beaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "name": "network-vif-unplugged", "status": "completed", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:36 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-38620556-60e0-4b18-b576-c43f2c28a3db req-8a3173f2-7a5f-41dc-871b-5e0617f5beaf service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:36 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-38620556-60e0-4b18-b576-c43f2c28a3db req-8a3173f2-7a5f-41dc-871b-5e0617f5beaf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:36 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-38620556-60e0-4b18-b576-c43f2c28a3db req-8a3173f2-7a5f-41dc-871b-5e0617f5beaf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-38620556-60e0-4b18-b576-c43f2c28a3db req-8a3173f2-7a5f-41dc-871b-5e0617f5beaf service nova] Creating event network-vif-unplugged:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:55:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-38620556-60e0-4b18-b576-c43f2c28a3db req-8a3173f2-7a5f-41dc-871b-5e0617f5beaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065950 Apr 18 12:55:36 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 56/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:38 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "name": "network-vif-plugged", "status": "completed", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}, {"server_uuid": "ee1d533c-0371-4785-9d2e-163994acd8bc", "name": "network-vif-deleted", "tag": "1d221881-fb6c-4ff3-a127-f7faf09aefa4"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] Creating event network-vif-plugged:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:55:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] Creating event network-vif-deleted:1d221881-fb6c-4ff3-a127-f7faf09aefa4 for instance ee1d533c-0371-4785-9d2e-163994acd8bc on user Apr 18 12:55:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-50a8bc54-6baa-49fd-86b6-7bb828594b18 req-7436554c-5a7d-4b5e-bc9a-1bbb135fbf70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035217 Apr 18 12:55:38 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 51/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:40 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1917555227", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "51847ea3-3c22-40cf-a9fc-97a5fa333674"}]}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] validate_networks() for [('51847ea3-3c22-40cf-a9fc-97a5fa333674', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for user c85d24916dfd4caba3c62d5a25d4b18f and project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:55:41 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:55:41 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-c076dc86-63f8-4e1d-9deb-0a73e2f32187 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.632619 Apr 18 12:55:41 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 54/161] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 12:55:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 12:55:41 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f3686ea2-2701-4bf8-a5c2-8f04930e3665 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:41 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-f3686ea2-2701-4bf8-a5c2-8f04930e3665 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:41 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f3686ea2-2701-4bf8-a5c2-8f04930e3665 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:41 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f3686ea2-2701-4bf8-a5c2-8f04930e3665 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:41 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f3686ea2-2701-4bf8-a5c2-8f04930e3665 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:41 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f3686ea2-2701-4bf8-a5c2-8f04930e3665 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041" status: 200 len: 1395 microversion: 2.87 time: 0.076664 Apr 18 12:55:41 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 57/162] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:55:41 2023] GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 => generated 1395 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:55:44 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-6094441b-ce74-4073-8c59-13b0a123bd0f req-473ef64f-811a-4ff8-8fee-4104131bd0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97887118-b881-4406-9a78-955265a49041", "tag": "c31841c1-1b3a-4496-9b34-1996d37c3983"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:44 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-6094441b-ce74-4073-8c59-13b0a123bd0f req-473ef64f-811a-4ff8-8fee-4104131bd0a9 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:44 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-6094441b-ce74-4073-8c59-13b0a123bd0f req-473ef64f-811a-4ff8-8fee-4104131bd0a9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:44 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-6094441b-ce74-4073-8c59-13b0a123bd0f req-473ef64f-811a-4ff8-8fee-4104131bd0a9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:44 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-6094441b-ce74-4073-8c59-13b0a123bd0f req-473ef64f-811a-4ff8-8fee-4104131bd0a9 service nova] Creating event network-changed:c31841c1-1b3a-4496-9b34-1996d37c3983 for instance 97887118-b881-4406-9a78-955265a49041 on user Apr 18 12:55:44 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-6094441b-ce74-4073-8c59-13b0a123bd0f req-473ef64f-811a-4ff8-8fee-4104131bd0a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026724 Apr 18 12:55:44 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 52/163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:46 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-43ebf8b2-6968-4859-9899-e78a286f434d req-22d01712-76a8-4633-87d2-986bc241fc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97887118-b881-4406-9a78-955265a49041", "name": "network-vif-plugged", "status": "completed", "tag": "c31841c1-1b3a-4496-9b34-1996d37c3983"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-43ebf8b2-6968-4859-9899-e78a286f434d req-22d01712-76a8-4633-87d2-986bc241fc04 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-43ebf8b2-6968-4859-9899-e78a286f434d req-22d01712-76a8-4633-87d2-986bc241fc04 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-43ebf8b2-6968-4859-9899-e78a286f434d req-22d01712-76a8-4633-87d2-986bc241fc04 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:46 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-43ebf8b2-6968-4859-9899-e78a286f434d req-22d01712-76a8-4633-87d2-986bc241fc04 service nova] Creating event network-vif-plugged:c31841c1-1b3a-4496-9b34-1996d37c3983 for instance 97887118-b881-4406-9a78-955265a49041 on user Apr 18 12:55:46 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-43ebf8b2-6968-4859-9899-e78a286f434d req-22d01712-76a8-4633-87d2-986bc241fc04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030487 Apr 18 12:55:46 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 55/164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:48 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-7114d391-372c-4039-a78c-a2912fd9b681 req-bbb1ec89-c663-4103-8b1d-aefb263e110a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97887118-b881-4406-9a78-955265a49041", "name": "network-vif-plugged", "status": "completed", "tag": "c31841c1-1b3a-4496-9b34-1996d37c3983"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:55:48 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=22 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7114d391-372c-4039-a78c-a2912fd9b681 req-bbb1ec89-c663-4103-8b1d-aefb263e110a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7114d391-372c-4039-a78c-a2912fd9b681 req-bbb1ec89-c663-4103-8b1d-aefb263e110a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7114d391-372c-4039-a78c-a2912fd9b681 req-bbb1ec89-c663-4103-8b1d-aefb263e110a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:48 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-7114d391-372c-4039-a78c-a2912fd9b681 req-bbb1ec89-c663-4103-8b1d-aefb263e110a service nova] Creating event network-vif-plugged:c31841c1-1b3a-4496-9b34-1996d37c3983 for instance 97887118-b881-4406-9a78-955265a49041 on user Apr 18 12:55:48 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-7114d391-372c-4039-a78c-a2912fd9b681 req-bbb1ec89-c663-4103-8b1d-aefb263e110a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035781 Apr 18 12:55:48 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 58/165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:49 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] HTTP exception thrown: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Request method failure captured: Apr 18 12:55:49 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff HTTP/1.1 Apr 18 12:55:49 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:55:49 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:55:49 user devstack@n-api.service[61393]: Connection: close Apr 18 12:55:49 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:55:49 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:55:49 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:55:49 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:55:49 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpKSEfv5LQz5UFeUrQNjnacJvVb1X32uScbk9ZxnptcfA_O9BqwrPtSgovr0bhbNmJgQGBd79R5SS4D3br_Ju2wBSIO9QjBqSwko2wIM7eu17A3rm8PWlBEOwkjqT_xze6mvR0mnaYTOKUn7BTO6eZ3kfgGHu8Z0EYN34shxY9DzgPE Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Project-Id: f100c45c0a3f42c89a9b63303871d801 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Tenant-Id: f100c45c0a3f42c89a9b63303871d801 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-User: tempest-AttachSCSIVolumeTestJSON-1033368162-project-member Apr 18 12:55:49 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:55:49 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:55:49 user devstack@n-api.service[61393]: X-User-Id: 175c9e4b73b04177a12fefc47c8879c7 Apr 18 12:55:49 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1033368162-project-member Apr 18 12:55:49 user devstack@n-api.service[61393]: method: > Apr 18 12:55:49 user devstack@n-api.service[61393]: exception: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:49 user devstack@n-api.service[61393]: action_args: {'id': '1c3ae6a4-b3d8-4733-bf29-e9efa950baff'} Apr 18 12:55:49 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:49 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:49 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Returning 404 to user: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:55:49 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5de51ab1-7e39-424b-a963-bc43fc7baaad tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 404 len: 111 microversion: 2.1 time: 0.029006 Apr 18 12:55:49 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 53/166] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:49 2023] GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:55:49 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b7341ac2-49de-4416-8de1-cf5a1d207d9d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '.version_select at 0x7fcf0e4b9870>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:49 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b7341ac2-49de-4416-8de1-cf5a1d207d9d tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19442091" status: 202 len: 0 microversion: 2.1 time: 0.021112 Apr 18 12:55:49 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 12:55:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19442091 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] HTTP exception thrown: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Request method failure captured: Apr 18 12:55:50 user devstack@n-api.service[61394]: request: DELETE /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff HTTP/1.1 Apr 18 12:55:50 user devstack@n-api.service[61394]: Accept: application/json Apr 18 12:55:50 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 12:55:50 user devstack@n-api.service[61394]: Connection: close Apr 18 12:55:50 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 12:55:50 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 12:55:50 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 12:55:50 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 12:55:50 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpKSEfv5LQz5UFeUrQNjnacJvVb1X32uScbk9ZxnptcfA_O9BqwrPtSgovr0bhbNmJgQGBd79R5SS4D3br_Ju2wBSIO9QjBqSwko2wIM7eu17A3rm8PWlBEOwkjqT_xze6mvR0mnaYTOKUn7BTO6eZ3kfgGHu8Z0EYN34shxY9DzgPE Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Project-Id: f100c45c0a3f42c89a9b63303871d801 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Tenant-Id: f100c45c0a3f42c89a9b63303871d801 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-User: tempest-AttachSCSIVolumeTestJSON-1033368162-project-member Apr 18 12:55:50 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 12:55:50 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 12:55:50 user devstack@n-api.service[61394]: X-User-Id: 175c9e4b73b04177a12fefc47c8879c7 Apr 18 12:55:50 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1033368162-project-member Apr 18 12:55:50 user devstack@n-api.service[61394]: method: > Apr 18 12:55:50 user devstack@n-api.service[61394]: exception: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61394]: action_args: {'id': '1c3ae6a4-b3d8-4733-bf29-e9efa950baff'} Apr 18 12:55:50 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Returning 404 to user: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:55:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-63df7104-4275-4cd7-b42f-9c092c6f17cc tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 404 len: 111 microversion: 2.1 time: 0.033084 Apr 18 12:55:50 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 59/168] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:55:50 2023] DELETE /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] [instance: 1c3ae6a4-b3d8-4733-bf29-e9efa950baff] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] HTTP exception thrown: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Request method failure captured: Apr 18 12:55:50 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff HTTP/1.1 Apr 18 12:55:50 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:55:50 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:55:50 user devstack@n-api.service[61393]: Connection: close Apr 18 12:55:50 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:55:50 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:55:50 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:55:50 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:55:50 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpKSEfv5LQz5UFeUrQNjnacJvVb1X32uScbk9ZxnptcfA_O9BqwrPtSgovr0bhbNmJgQGBd79R5SS4D3br_Ju2wBSIO9QjBqSwko2wIM7eu17A3rm8PWlBEOwkjqT_xze6mvR0mnaYTOKUn7BTO6eZ3kfgGHu8Z0EYN34shxY9DzgPE Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Project-Id: f100c45c0a3f42c89a9b63303871d801 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f100c45c0a3f42c89a9b63303871d801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Tenant-Id: f100c45c0a3f42c89a9b63303871d801 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1033368162 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-User: tempest-AttachSCSIVolumeTestJSON-1033368162-project-member Apr 18 12:55:50 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:55:50 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:55:50 user devstack@n-api.service[61393]: X-User-Id: 175c9e4b73b04177a12fefc47c8879c7 Apr 18 12:55:50 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1033368162-project-member Apr 18 12:55:50 user devstack@n-api.service[61393]: method: > Apr 18 12:55:50 user devstack@n-api.service[61393]: exception: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61393]: action_args: {'id': '1c3ae6a4-b3d8-4733-bf29-e9efa950baff'} Apr 18 12:55:50 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. Apr 18 12:55:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:55:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] Returning 404 to user: Instance 1c3ae6a4-b3d8-4733-bf29-e9efa950baff could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:55:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-d15e0ca3-bf0f-41fb-82d9-bfc3d10dc797 tempest-AttachSCSIVolumeTestJSON-1033368162 tempest-AttachSCSIVolumeTestJSON-1033368162-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff" status: 404 len: 111 microversion: 2.1 time: 0.026819 Apr 18 12:55:50 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 54/169] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:50 2023] GET /compute/v2.1/servers/1c3ae6a4-b3d8-4733-bf29-e9efa950baff => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:55:55 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37faecb47ed4c8e8dea21ee364164e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c47472a1a3e4494801cea627fe6cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:55:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e504c726-3442-412f-9326-5376ded2770c tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02" status: 200 len: 1495 microversion: 2.1 time: 0.427073 Apr 18 12:55:55 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:55:55 2023] GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02 => generated 1495 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:03 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:03 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=24 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:03 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-634192973", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] validate_networks() for [('053a0264-8531-4efe-a4fe-82ade775d436', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Getting quotas for project 3891288074444cadbdc9642ffae69e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Getting quotas for user cb05642f149e41149aab9393241bbddc and project 3891288074444cadbdc9642ffae69e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:56:04 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:56:04 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-e6722c00-fe03-41ba-9880-572c6120f152 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.676789 Apr 18 12:56:04 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 60/171] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:56:03 2023] POST /compute/v2.1/servers => generated 381 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:56:04 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5e1885f9-fa0e-400f-9314-f847b1877986 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:04 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5e1885f9-fa0e-400f-9314-f847b1877986 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:04 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:04 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:04 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-5e1885f9-fa0e-400f-9314-f847b1877986 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:04 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5e1885f9-fa0e-400f-9314-f847b1877986 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06" status: 200 len: 1215 microversion: 2.1 time: 0.070629 Apr 18 12:56:04 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 55/172] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:04 2023] GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:04 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1963187047", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:04 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] validate_networks() for [('053a0264-8531-4efe-a4fe-82ade775d436', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Getting quotas for project 3891288074444cadbdc9642ffae69e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Getting quotas for user cb05642f149e41149aab9393241bbddc and project 3891288074444cadbdc9642ffae69e5d. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:56:05 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:56:05 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b8e8be45-938a-4123-8d65-703a2440945a tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.654818 Apr 18 12:56:05 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 58/173] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:56:04 2023] POST /compute/v2.1/servers => generated 381 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:56:05 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-3db7db05-668f-40c8-9a32-8673f48ccd97 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:05 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-3db7db05-668f-40c8-9a32-8673f48ccd97 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:05 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-3db7db05-668f-40c8-9a32-8673f48ccd97 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:05 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-3db7db05-668f-40c8-9a32-8673f48ccd97 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 200 len: 1216 microversion: 2.1 time: 0.059697 Apr 18 12:56:05 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 61/174] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:05 2023] GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 1216 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-cf5ef0f4-5ba2-4d10-bdd9-f37947992c7a req-bcae2451-1609-456f-8238-a72f5ecf3c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d928be03-793a-4b7c-810e-e4af90206e06", "tag": "913f05d6-4a84-44f2-b13f-f49b2b132fc4"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:07 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-cf5ef0f4-5ba2-4d10-bdd9-f37947992c7a req-bcae2451-1609-456f-8238-a72f5ecf3c87 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:07 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-cf5ef0f4-5ba2-4d10-bdd9-f37947992c7a req-bcae2451-1609-456f-8238-a72f5ecf3c87 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:07 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-cf5ef0f4-5ba2-4d10-bdd9-f37947992c7a req-bcae2451-1609-456f-8238-a72f5ecf3c87 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-cf5ef0f4-5ba2-4d10-bdd9-f37947992c7a req-bcae2451-1609-456f-8238-a72f5ecf3c87 service nova] Creating event network-changed:913f05d6-4a84-44f2-b13f-f49b2b132fc4 for instance d928be03-793a-4b7c-810e-e4af90206e06 on user Apr 18 12:56:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-cf5ef0f4-5ba2-4d10-bdd9-f37947992c7a req-bcae2451-1609-456f-8238-a72f5ecf3c87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031083 Apr 18 12:56:07 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 56/175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:08 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-a83f3652-81da-4350-90fa-102dd89b7003 req-46df5e10-5632-4abb-83ed-ef656e2b9f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-a83f3652-81da-4350-90fa-102dd89b7003 req-46df5e10-5632-4abb-83ed-ef656e2b9f21 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-a83f3652-81da-4350-90fa-102dd89b7003 req-46df5e10-5632-4abb-83ed-ef656e2b9f21 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-a83f3652-81da-4350-90fa-102dd89b7003 req-46df5e10-5632-4abb-83ed-ef656e2b9f21 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:08 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-a83f3652-81da-4350-90fa-102dd89b7003 req-46df5e10-5632-4abb-83ed-ef656e2b9f21 service nova] Creating event network-changed:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:56:08 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-a83f3652-81da-4350-90fa-102dd89b7003 req-46df5e10-5632-4abb-83ed-ef656e2b9f21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028811 Apr 18 12:56:08 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:10 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-9e4f90db-b490-4322-9342-695b9bf0172b req-c330a8bb-a7da-4e3d-af07-2a6aa956cb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d928be03-793a-4b7c-810e-e4af90206e06", "name": "network-vif-plugged", "status": "completed", "tag": "913f05d6-4a84-44f2-b13f-f49b2b132fc4"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-9e4f90db-b490-4322-9342-695b9bf0172b req-c330a8bb-a7da-4e3d-af07-2a6aa956cb71 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-9e4f90db-b490-4322-9342-695b9bf0172b req-c330a8bb-a7da-4e3d-af07-2a6aa956cb71 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-9e4f90db-b490-4322-9342-695b9bf0172b req-c330a8bb-a7da-4e3d-af07-2a6aa956cb71 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:10 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-9e4f90db-b490-4322-9342-695b9bf0172b req-c330a8bb-a7da-4e3d-af07-2a6aa956cb71 service nova] Creating event network-vif-plugged:913f05d6-4a84-44f2-b13f-f49b2b132fc4 for instance d928be03-793a-4b7c-810e-e4af90206e06 on user Apr 18 12:56:10 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-9e4f90db-b490-4322-9342-695b9bf0172b req-c330a8bb-a7da-4e3d-af07-2a6aa956cb71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Apr 18 12:56:10 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 62/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:12 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d928be03-793a-4b7c-810e-e4af90206e06", "name": "network-vif-plugged", "status": "completed", "tag": "913f05d6-4a84-44f2-b13f-f49b2b132fc4"}, {"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-plugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}, {"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-plugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:12 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:12 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:12 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Creating event network-vif-plugged:913f05d6-4a84-44f2-b13f-f49b2b132fc4 for instance d928be03-793a-4b7c-810e-e4af90206e06 on user Apr 18 12:56:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Creating event network-vif-plugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:56:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] Creating event network-vif-plugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:56:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-db504717-dbf9-4a05-8dcb-58a62b59892f req-262ce126-e253-47cc-81ca-c11b2829dbe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038714 Apr 18 12:56:12 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 57/178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: f245f166-497f-4543-b899-2898dbb4c250] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:16 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] HTTP exception thrown: Instance f245f166-497f-4543-b899-2898dbb4c250 could not be found. Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Request method failure captured: Apr 18 12:56:16 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 HTTP/1.1 Apr 18 12:56:16 user devstack@n-api.service[61395]: Accept: application/json Apr 18 12:56:16 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 12:56:16 user devstack@n-api.service[61395]: Connection: close Apr 18 12:56:16 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 12:56:16 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 12:56:16 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 12:56:16 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 12:56:16 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpK9jvvalBCHdrunNLT-ToGdwh7Nkb6C4hpciGiySnOzpq0PmQRVdvQjBnBa4_Ij8kyFm7AYiyyUOjyR5DcTn_FIWrBnKyHpYeCRA__t2nfp8IXD54RJhXhkpTFeT0c0z_k_EZDvgQPIHQXna8ldHfxDnhDYz5RQmBnDcodG8sPkH8U Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Project-Id: 91be86ea743d46ed9f1e7ed2dcc5a780 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Project-Name: tempest-TestMinimumBasicScenario-283436028 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91be86ea743d46ed9f1e7ed2dcc5a780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91be86ea743d46ed9f1e7ed2dcc5a780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91be86ea743d46ed9f1e7ed2dcc5a780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Tenant: tempest-TestMinimumBasicScenario-283436028 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Tenant-Id: 91be86ea743d46ed9f1e7ed2dcc5a780 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-TestMinimumBasicScenario-283436028 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-User: tempest-TestMinimumBasicScenario-283436028-project-member Apr 18 12:56:16 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 12:56:16 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 12:56:16 user devstack@n-api.service[61395]: X-User-Id: 09e7674bd0a24feead88eb5b7338ae99 Apr 18 12:56:16 user devstack@n-api.service[61395]: X-User-Name: tempest-TestMinimumBasicScenario-283436028-project-member Apr 18 12:56:16 user devstack@n-api.service[61395]: method: > Apr 18 12:56:16 user devstack@n-api.service[61395]: exception: Instance f245f166-497f-4543-b899-2898dbb4c250 could not be found. Apr 18 12:56:16 user devstack@n-api.service[61395]: action_args: {'id': 'f245f166-497f-4543-b899-2898dbb4c250'} Apr 18 12:56:16 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f245f166-497f-4543-b899-2898dbb4c250 could not be found. Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f245f166-497f-4543-b899-2898dbb4c250 could not be found. Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f245f166-497f-4543-b899-2898dbb4c250 could not be found. Apr 18 12:56:16 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:56:16 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Returning 404 to user: Instance f245f166-497f-4543-b899-2898dbb4c250 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:56:16 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-7f8673a9-bac8-406f-967c-70a0ade48e14 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250" status: 404 len: 111 microversion: 2.1 time: 0.038185 Apr 18 12:56:16 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:16 2023] GET /compute/v2.1/servers/f245f166-497f-4543-b899-2898dbb4c250 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:56:16 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:16 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=8 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:16 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-a733d000-51d9-4fc2-b790-6ac8aec754d9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '.version_select at 0x7fcf0cee9ab0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:16 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-a733d000-51d9-4fc2-b790-6ac8aec754d9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1275329585" status: 202 len: 0 microversion: 2.1 time: 0.027475 Apr 18 12:56:16 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 63/180] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 12:56:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1275329585 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:56:18 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:18 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-2d1a324e-6d85-4865-a985-b92c15422baf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cd87a30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2131296057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy7dJNIRrlEum8Xm+TyN8YSh3jr9AsLMsLAFHZqCL/z3NnG8pQLmmTQ8ToqlTYs5GFvQmtCjSk9mrevk32fx0H5IkkACUFN9mMA60xPlfol880WMEVC/UYEruhmZrypiQ=="}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:18 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-2d1a324e-6d85-4865-a985-b92c15422baf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:56:18 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-2d1a324e-6d85-4865-a985-b92c15422baf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for user 09e7674bd0a24feead88eb5b7338ae99 and project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:56:18 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-2d1a324e-6d85-4865-a985-b92c15422baf tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045006 Apr 18 12:56:18 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 58/181] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:56:18 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:18 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-993207306", "imageRef": "c6b4d806-b666-4cd3-a1a5-6ccb495acdcc", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2131296057", "networks": [{"uuid": "569bedd9-9452-4f31-aeae-2dd11fccbd2c"}]}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:18 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] validate_networks() for [('569bedd9-9452-4f31-aeae-2dd11fccbd2c', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Getting quotas for user 09e7674bd0a24feead88eb5b7338ae99 and project 91be86ea743d46ed9f1e7ed2dcc5a780. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:56:19 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6b4d806-b666-4cd3-a1a5-6ccb495acdcc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:56:19 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-71499705-47eb-4f64-8ef1-3fbe3b02c200 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.621589 Apr 18 12:56:19 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 61/182] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:56:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:56:19 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-22e6484f-5e8c-40ec-b48c-1a76ae62de10 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:19 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-22e6484f-5e8c-40ec-b48c-1a76ae62de10 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:19 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-22e6484f-5e8c-40ec-b48c-1a76ae62de10 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:19 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-22e6484f-5e8c-40ec-b48c-1a76ae62de10 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 200 len: 1252 microversion: 2.1 time: 0.070935 Apr 18 12:56:19 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 64/183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:19 2023] GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 1252 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:22 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-87864348-ac53-4cb2-bda6-c15c242576b2 req-90bcd9dc-bb1a-4e6a-9461-0923b020418d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb082fc-1009-4af6-a6ce-98ff430f84c4", "tag": "e3b16c98-9245-411b-b6c5-fd20c24b1a03"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-87864348-ac53-4cb2-bda6-c15c242576b2 req-90bcd9dc-bb1a-4e6a-9461-0923b020418d service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-87864348-ac53-4cb2-bda6-c15c242576b2 req-90bcd9dc-bb1a-4e6a-9461-0923b020418d service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-87864348-ac53-4cb2-bda6-c15c242576b2 req-90bcd9dc-bb1a-4e6a-9461-0923b020418d service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-87864348-ac53-4cb2-bda6-c15c242576b2 req-90bcd9dc-bb1a-4e6a-9461-0923b020418d service nova] Creating event network-changed:e3b16c98-9245-411b-b6c5-fd20c24b1a03 for instance abb082fc-1009-4af6-a6ce-98ff430f84c4 on user Apr 18 12:56:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-87864348-ac53-4cb2-bda6-c15c242576b2 req-90bcd9dc-bb1a-4e6a-9461-0923b020418d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036561 Apr 18 12:56:22 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 59/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:24 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-4f44dbfc-34c7-42f1-af23-416e052be46e req-0ae5f13b-3070-4aae-9ca1-97a9ea404e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb082fc-1009-4af6-a6ce-98ff430f84c4", "name": "network-vif-plugged", "status": "completed", "tag": "e3b16c98-9245-411b-b6c5-fd20c24b1a03"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:24 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4f44dbfc-34c7-42f1-af23-416e052be46e req-0ae5f13b-3070-4aae-9ca1-97a9ea404e1c service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:24 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4f44dbfc-34c7-42f1-af23-416e052be46e req-0ae5f13b-3070-4aae-9ca1-97a9ea404e1c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:24 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4f44dbfc-34c7-42f1-af23-416e052be46e req-0ae5f13b-3070-4aae-9ca1-97a9ea404e1c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:24 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-4f44dbfc-34c7-42f1-af23-416e052be46e req-0ae5f13b-3070-4aae-9ca1-97a9ea404e1c service nova] Creating event network-vif-plugged:e3b16c98-9245-411b-b6c5-fd20c24b1a03 for instance abb082fc-1009-4af6-a6ce-98ff430f84c4 on user Apr 18 12:56:24 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-4f44dbfc-34c7-42f1-af23-416e052be46e req-0ae5f13b-3070-4aae-9ca1-97a9ea404e1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042862 Apr 18 12:56:24 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:25 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-684d0b7d-87b0-4902-9c5a-7fbb719a2f8b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '.version_select at 0x7fcf0ceeb640>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-684d0b7d-87b0-4902-9c5a-7fbb719a2f8b tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930" status: 200 len: 1723 microversion: 2.1 time: 0.067495 Apr 18 12:56:25 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 65/186] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 12:56:25 2023] GET /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930 => generated 1723 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-52d30d94-48cf-4858-903c-8492c6b620e0 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '.version_select at 0x7fcf0cd87d90>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-52d30d94-48cf-4858-903c-8492c6b620e0 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930" status: 200 len: 1723 microversion: 2.1 time: 0.055899 Apr 18 12:56:25 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 60/187] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 12:56:25 2023] GET /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930 => generated 1723 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:25 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28484fa4ad2e484f9a612941b5d6b335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e0b5cb088a4562864d07104be87a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-0e2ae2f1-87e4-4e5d-b3aa-047f4fe2043f tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 200 len: 1671 microversion: 2.1 time: 0.225416 Apr 18 12:56:25 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:25 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:26 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] HTTP exception thrown: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Request method failure captured: Apr 18 12:56:26 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc HTTP/1.1 Apr 18 12:56:26 user devstack@n-api.service[61394]: Accept: application/json Apr 18 12:56:26 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 12:56:26 user devstack@n-api.service[61394]: Connection: close Apr 18 12:56:26 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 12:56:26 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 12:56:26 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 12:56:26 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 12:56:26 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpLSjnWOgvJtR5uZ0eIzksf5JHzbIMn-nM_KMFJDK8YqmVs9sxtY1Hhi2oqNgDhyx37Ce7fczv2PhL5sM_bFJACWxOmdYSbVTszh_xtC5WBcf3pqkF2kfDo41pc8bweq7TQivAX6xiDJ-ecb5FgpPTFE1HP4B0ecLp9kKBrbAFfUYUk Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Project-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Tenant-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:56:26 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:56:26 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 12:56:26 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 12:56:26 user devstack@n-api.service[61394]: X-User-Id: d6575d954aca4737bb6e943143d434fb Apr 18 12:56:26 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:56:26 user devstack@n-api.service[61394]: method: > Apr 18 12:56:26 user devstack@n-api.service[61394]: exception: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:56:26 user devstack@n-api.service[61394]: action_args: {'id': 'ee1d533c-0371-4785-9d2e-163994acd8bc'} Apr 18 12:56:26 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:56:26 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:56:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Returning 404 to user: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:56:26 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-0240c0ed-3632-484c-8f39-01c4dae25d62 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 404 len: 111 microversion: 2.20 time: 0.029557 Apr 18 12:56:26 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 66/189] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:56:26 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:56:26 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-0fc7c5ad-7b32-46ba-88ab-b6fb1fc721c6 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '.version_select at 0x7fcf0cd87880>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:26 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-fcb1f301-2da1-4953-ab32-6e67ee0c3a4b req-ef1403c0-e3a3-4237-ab16-698dbc2e1c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb082fc-1009-4af6-a6ce-98ff430f84c4", "name": "network-vif-plugged", "status": "completed", "tag": "e3b16c98-9245-411b-b6c5-fd20c24b1a03"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:26 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-fcb1f301-2da1-4953-ab32-6e67ee0c3a4b req-ef1403c0-e3a3-4237-ab16-698dbc2e1c04 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-fcb1f301-2da1-4953-ab32-6e67ee0c3a4b req-ef1403c0-e3a3-4237-ab16-698dbc2e1c04 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:26 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-fcb1f301-2da1-4953-ab32-6e67ee0c3a4b req-ef1403c0-e3a3-4237-ab16-698dbc2e1c04 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:26 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-0fc7c5ad-7b32-46ba-88ab-b6fb1fc721c6 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699262919" status: 204 len: 0 microversion: 2.20 time: 0.023818 Apr 18 12:56:26 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 61/190] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 12:56:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699262919 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 12:56:26 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=22 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:26 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-fcb1f301-2da1-4953-ab32-6e67ee0c3a4b req-ef1403c0-e3a3-4237-ab16-698dbc2e1c04 service nova] Creating event network-vif-plugged:e3b16c98-9245-411b-b6c5-fd20c24b1a03 for instance abb082fc-1009-4af6-a6ce-98ff430f84c4 on user Apr 18 12:56:26 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-fcb1f301-2da1-4953-ab32-6e67ee0c3a4b req-ef1403c0-e3a3-4237-ab16-698dbc2e1c04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041860 Apr 18 12:56:26 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 64/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:27 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-6a4021d6-7710-459f-886e-d2c168dd58f0 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cee9240>, body: {"keypair": {"name": "tempest-keypair-1061869806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtlP5v5lmG+FspTs3gT5Pg0wkZhGKZtUIO4zdcaUbPRxQKmfahh2X/NJoY6gg/JU6mtU8bm04aCVdg5+rrElzaaF/pekIhdcKgp3k5cyv3d0FLcpKuGD91qfEChd2eN1Q=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:27 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-6a4021d6-7710-459f-886e-d2c168dd58f0 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:56:27 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-6a4021d6-7710-459f-886e-d2c168dd58f0 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for user d6575d954aca4737bb6e943143d434fb and project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:56:27 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-6a4021d6-7710-459f-886e-d2c168dd58f0 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043900 Apr 18 12:56:27 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 67/192] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 12:56:27 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 12:56:28 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:28 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1990878987", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d2c52673-0449-495a-98f4-b55441b493d7"}], "security_groups": [{"name": "tempest-securitygroup--928266581"}], "key_name": "tempest-keypair-1061869806", "user_data": "}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] validate_networks() for [('d2c52673-0449-495a-98f4-b55441b493d7', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Getting quotas for user d6575d954aca4737bb6e943143d434fb and project 2141ea57b3164da2b77659a221c2b3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:56:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:56:29 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-659c2961-e379-4839-a9d7-453146fc7868 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.621537 Apr 18 12:56:29 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 62/193] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 12:56:28 2023] POST /compute/v2.1/servers => generated 399 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-42ec8b63-5659-4beb-b431-c115af77bb6e tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-42ec8b63-5659-4beb-b431-c115af77bb6e tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-42ec8b63-5659-4beb-b431-c115af77bb6e tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-42ec8b63-5659-4beb-b431-c115af77bb6e tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:29 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-42ec8b63-5659-4beb-b431-c115af77bb6e tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:29 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-42ec8b63-5659-4beb-b431-c115af77bb6e tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 200 len: 1276 microversion: 2.20 time: 0.090038 Apr 18 12:56:29 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 65/194] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:56:29 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:31 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:31 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f1ad64b8-31d6-41e7-b113-61512f833f6b tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041" status: 200 len: 1691 microversion: 2.87 time: 0.269451 Apr 18 12:56:31 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 68/195] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:56:31 2023] GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:56:32 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-9c9e326f-b88e-4fb4-bbae-fc29d68558ab req-2b35b4c7-8059-42f0-9fec-092ebda1b740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-9c9e326f-b88e-4fb4-bbae-fc29d68558ab req-2b35b4c7-8059-42f0-9fec-092ebda1b740 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-9c9e326f-b88e-4fb4-bbae-fc29d68558ab req-2b35b4c7-8059-42f0-9fec-092ebda1b740 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-9c9e326f-b88e-4fb4-bbae-fc29d68558ab req-2b35b4c7-8059-42f0-9fec-092ebda1b740 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:32 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-9c9e326f-b88e-4fb4-bbae-fc29d68558ab req-2b35b4c7-8059-42f0-9fec-092ebda1b740 service nova] Creating event network-changed:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:56:32 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-9c9e326f-b88e-4fb4-bbae-fc29d68558ab req-2b35b4c7-8059-42f0-9fec-092ebda1b740 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030592 Apr 18 12:56:32 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 63/196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:32 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:32 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-14d28629-6a0e-4094-a93f-e9bc5fe4d871 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.347428 Apr 18 12:56:32 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:32 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:34 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-aef79f88-a262-4e39-96b4-0ad714ad98d3 req-221176a5-3ec2-4e63-91b3-7bd91dec0e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "name": "network-vif-plugged", "status": "completed", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:34 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-aef79f88-a262-4e39-96b4-0ad714ad98d3 req-221176a5-3ec2-4e63-91b3-7bd91dec0e55 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-aef79f88-a262-4e39-96b4-0ad714ad98d3 req-221176a5-3ec2-4e63-91b3-7bd91dec0e55 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-aef79f88-a262-4e39-96b4-0ad714ad98d3 req-221176a5-3ec2-4e63-91b3-7bd91dec0e55 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-aef79f88-a262-4e39-96b4-0ad714ad98d3 req-221176a5-3ec2-4e63-91b3-7bd91dec0e55 service nova] Creating event network-vif-plugged:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:56:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-aef79f88-a262-4e39-96b4-0ad714ad98d3 req-221176a5-3ec2-4e63-91b3-7bd91dec0e55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046608 Apr 18 12:56:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 69/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=11 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:34 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:56:35 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-1f233cb3-e57e-4180-a7cc-bf03a66a04ff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 204 len: 0 microversion: 2.1 time: 0.144388 Apr 18 12:56:35 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 64/199] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:56:34 2023] DELETE /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:35 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:35 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b80c83b7-cffa-4328-9b38-0e29de520c5a tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 200 len: 1500 microversion: 2.1 time: 0.396492 Apr 18 12:56:35 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:35 2023] GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 1500 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:36 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "name": "network-vif-plugged", "status": "completed", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}, {"server_uuid": "d01aeff8-a91d-477a-a530-4147ce9670fd", "name": "network-vif-unplugged", "status": "completed", "tag": "17378aa8-b1fb-47fc-8780-eefa30699267"}, {"server_uuid": "d01aeff8-a91d-477a-a530-4147ce9670fd", "name": "network-vif-plugged", "status": "completed", "tag": "17378aa8-b1fb-47fc-8780-eefa30699267"}, {"server_uuid": "d01aeff8-a91d-477a-a530-4147ce9670fd", "name": "network-vif-deleted", "tag": "17378aa8-b1fb-47fc-8780-eefa30699267"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:36 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:36 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:36 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Creating event network-vif-plugged:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:56:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Creating event network-vif-unplugged:17378aa8-b1fb-47fc-8780-eefa30699267 for instance d01aeff8-a91d-477a-a530-4147ce9670fd on user Apr 18 12:56:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Creating event network-vif-plugged:17378aa8-b1fb-47fc-8780-eefa30699267 for instance d01aeff8-a91d-477a-a530-4147ce9670fd on user Apr 18 12:56:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] Creating event network-vif-deleted:17378aa8-b1fb-47fc-8780-eefa30699267 for instance d01aeff8-a91d-477a-a530-4147ce9670fd on user Apr 18 12:56:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-433f9ec3-361c-42d6-af02-dcbe33732dc9 req-efca0bc9-d261-4967-a663-70dda9a4d5bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.038086 Apr 18 12:56:36 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 70/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:36 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=6 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:55 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:55 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-cbc6c89e-2ba2-4bfb-aabb-2d7993ee72f2 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 200 len: 1503 microversion: 2.1 time: 0.245252 Apr 18 12:56:55 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 65/202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:55 2023] GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=9 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=13 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:57 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] Going to try to terminate instance {{(pid=61395) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:56:57 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b017b719-c221-4d7e-9de1-e22fa1ab1dc4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02" status: 204 len: 0 microversion: 2.1 time: 0.126269 Apr 18 12:56:57 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:56:57 2023] DELETE /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=3 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=12 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:57 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-5a89c403-9972-4906-b9df-264675c47479 req-9fb943fb-586c-44a7-bd98-9737163c2ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68780c76-c582-470e-81ad-6be81909ae02", "name": "network-vif-unplugged", "status": "completed", "tag": "48d76b52-3745-4d28-a4ae-a8912c42500e"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:57 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5a89c403-9972-4906-b9df-264675c47479 req-9fb943fb-586c-44a7-bd98-9737163c2ae7 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:57 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5a89c403-9972-4906-b9df-264675c47479 req-9fb943fb-586c-44a7-bd98-9737163c2ae7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:57 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5a89c403-9972-4906-b9df-264675c47479 req-9fb943fb-586c-44a7-bd98-9737163c2ae7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:57 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37faecb47ed4c8e8dea21ee364164e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c47472a1a3e4494801cea627fe6cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:56:57 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-5a89c403-9972-4906-b9df-264675c47479 req-9fb943fb-586c-44a7-bd98-9737163c2ae7 service nova] Creating event network-vif-unplugged:48d76b52-3745-4d28-a4ae-a8912c42500e for instance 68780c76-c582-470e-81ad-6be81909ae02 on user Apr 18 12:56:57 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-1489c765-4926-4d37-b48e-eb6c89d0d405 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02" status: 200 len: 1501 microversion: 2.1 time: 0.351806 Apr 18 12:56:57 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 71/204] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:56:57 2023] GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02 => generated 1501 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:56:57 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-5a89c403-9972-4906-b9df-264675c47479 req-9fb943fb-586c-44a7-bd98-9737163c2ae7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032764 Apr 18 12:56:57 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 66/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:58 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-277e16a7-9474-49a9-a6f2-841e2b89baad req-9ea40284-8f03-4f64-91d2-fd43af82e960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68780c76-c582-470e-81ad-6be81909ae02", "name": "network-vif-deleted", "tag": "48d76b52-3745-4d28-a4ae-a8912c42500e"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-277e16a7-9474-49a9-a6f2-841e2b89baad req-9ea40284-8f03-4f64-91d2-fd43af82e960 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-277e16a7-9474-49a9-a6f2-841e2b89baad req-9ea40284-8f03-4f64-91d2-fd43af82e960 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-277e16a7-9474-49a9-a6f2-841e2b89baad req-9ea40284-8f03-4f64-91d2-fd43af82e960 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-277e16a7-9474-49a9-a6f2-841e2b89baad req-9ea40284-8f03-4f64-91d2-fd43af82e960 service nova] Creating event network-vif-deleted:48d76b52-3745-4d28-a4ae-a8912c42500e for instance 68780c76-c582-470e-81ad-6be81909ae02 on user Apr 18 12:56:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-277e16a7-9474-49a9-a6f2-841e2b89baad req-9ea40284-8f03-4f64-91d2-fd43af82e960 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038361 Apr 18 12:56:58 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 69/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:56:59 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-d5dd945f-7989-45ab-a4e7-270687034d68 req-51932c1f-d9c5-4b64-b9ed-ea4b159bd208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68780c76-c582-470e-81ad-6be81909ae02", "name": "network-vif-plugged", "status": "completed", "tag": "48d76b52-3745-4d28-a4ae-a8912c42500e"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:56:59 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-d5dd945f-7989-45ab-a4e7-270687034d68 req-51932c1f-d9c5-4b64-b9ed-ea4b159bd208 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:56:59 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-d5dd945f-7989-45ab-a4e7-270687034d68 req-51932c1f-d9c5-4b64-b9ed-ea4b159bd208 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:56:59 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-d5dd945f-7989-45ab-a4e7-270687034d68 req-51932c1f-d9c5-4b64-b9ed-ea4b159bd208 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:56:59 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-d5dd945f-7989-45ab-a4e7-270687034d68 req-51932c1f-d9c5-4b64-b9ed-ea4b159bd208 service nova] Creating event network-vif-plugged:48d76b52-3745-4d28-a4ae-a8912c42500e for instance 68780c76-c582-470e-81ad-6be81909ae02 on user Apr 18 12:56:59 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-d5dd945f-7989-45ab-a4e7-270687034d68 req-51932c1f-d9c5-4b64-b9ed-ea4b159bd208 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028315 Apr 18 12:56:59 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 72/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=8 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:09 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-1ebdcb96-8c8e-46ae-8f5c-7395c72a2eaa tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 200 len: 1537 microversion: 2.1 time: 0.239763 Apr 18 12:57:09 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 67/208] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:09 2023] GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:19 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:19 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-d37dcb52-2b77-4341-b53f-ad9c60000f9f tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 200 len: 1587 microversion: 2.20 time: 0.260409 Apr 18 12:57:19 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 70/209] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:57:19 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 1587 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=8 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] HTTP exception thrown: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Request method failure captured: Apr 18 12:57:25 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd HTTP/1.1 Apr 18 12:57:25 user devstack@n-api.service[61394]: Accept: application/json Apr 18 12:57:25 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 12:57:25 user devstack@n-api.service[61394]: Connection: close Apr 18 12:57:25 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 12:57:25 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 12:57:25 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 12:57:25 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 12:57:25 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpKhgut7rFPA6_gSQJTVPdnWjqLLEowTwNLXudelhI-sYNMssNy343y6PMeV5h2Lnlo0V3zVAXU2T39cbXoooMf2iwx4c2MNExhrTINzHD5eblXiLG37HByo9orolGva623oiGqkQmxShxWJtZFNVkGf6TIs9WGwcmuLNl7NwKWtFfY Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Project-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Project-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Tenant: tempest-ServersNegativeTestJSON-1168573805 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Tenant-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-User: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 12:57:25 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 12:57:25 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 12:57:25 user devstack@n-api.service[61394]: X-User-Id: decaeb6e67f94c7a87fb782e089621f9 Apr 18 12:57:25 user devstack@n-api.service[61394]: X-User-Name: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 12:57:25 user devstack@n-api.service[61394]: method: > Apr 18 12:57:25 user devstack@n-api.service[61394]: exception: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 12:57:25 user devstack@n-api.service[61394]: action_args: {'id': 'd01aeff8-a91d-477a-a530-4147ce9670fd'} Apr 18 12:57:25 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 12:57:25 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:57:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Returning 404 to user: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:57:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-ba644c05-748e-40db-8340-2c5014d84447 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 404 len: 111 microversion: 2.1 time: 0.048278 Apr 18 12:57:25 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 73/210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:25 2023] GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=6 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:25 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-b69d7d58-bcdb-40c6-be6b-bd234fd202d6 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1493 microversion: 2.1 time: 0.325706 Apr 18 12:57:25 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 68/211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:25 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1493 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:26 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28484fa4ad2e484f9a612941b5d6b335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e0b5cb088a4562864d07104be87a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:26 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-8f246fec-32a5-48a1-8a1a-30b84fddd30c tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 200 len: 1671 microversion: 2.1 time: 0.298117 Apr 18 12:57:26 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:25 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 1671 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:27 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-9a0638ed-064a-42d2-bb05-6303324308ff tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '.version_select at 0x7fcf0ceea3b0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:27 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-9a0638ed-064a-42d2-bb05-6303324308ff tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930" status: 204 len: 0 microversion: 2.1 time: 0.317534 Apr 18 12:57:27 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 74/213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:27 2023] DELETE /compute/v2.1/images/a19f9318-d213-4a3e-b4fa-d2dc1fb41930 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:27 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:57:27 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-eb9db434-9645-400f-9cfd-ba867de01a06 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 204 len: 0 microversion: 2.1 time: 0.121122 Apr 18 12:57:27 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 69/214] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:57:27 2023] DELETE /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:28 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28484fa4ad2e484f9a612941b5d6b335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e0b5cb088a4562864d07104be87a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:28 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-02b5a130-e7fc-4005-b19b-5a5ddba45cf3 tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 200 len: 1677 microversion: 2.1 time: 0.201729 Apr 18 12:57:28 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:27 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:28 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-79565e88-0f66-4981-9c76-a27bab0fdef9 req-f69223f2-47b3-46c5-95d7-1595bf2a87e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:28 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-79565e88-0f66-4981-9c76-a27bab0fdef9 req-f69223f2-47b3-46c5-95d7-1595bf2a87e6 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:28 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-79565e88-0f66-4981-9c76-a27bab0fdef9 req-f69223f2-47b3-46c5-95d7-1595bf2a87e6 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:28 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-79565e88-0f66-4981-9c76-a27bab0fdef9 req-f69223f2-47b3-46c5-95d7-1595bf2a87e6 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:28 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-79565e88-0f66-4981-9c76-a27bab0fdef9 req-f69223f2-47b3-46c5-95d7-1595bf2a87e6 service nova] Creating event network-vif-unplugged:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:57:28 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-79565e88-0f66-4981-9c76-a27bab0fdef9 req-f69223f2-47b3-46c5-95d7-1595bf2a87e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029425 Apr 18 12:57:28 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 75/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:29 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-4c02a985-86d1-4086-825e-ae77a2790776 req-54629783-e408-43a2-b1c2-3a87523740c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "name": "network-vif-deleted", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4c02a985-86d1-4086-825e-ae77a2790776 req-54629783-e408-43a2-b1c2-3a87523740c7 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4c02a985-86d1-4086-825e-ae77a2790776 req-54629783-e408-43a2-b1c2-3a87523740c7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4c02a985-86d1-4086-825e-ae77a2790776 req-54629783-e408-43a2-b1c2-3a87523740c7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:29 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-4c02a985-86d1-4086-825e-ae77a2790776 req-54629783-e408-43a2-b1c2-3a87523740c7 service nova] Creating event network-vif-deleted:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:57:29 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-4c02a985-86d1-4086-825e-ae77a2790776 req-54629783-e408-43a2-b1c2-3a87523740c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048995 Apr 18 12:57:29 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 70/217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:30 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-8189fc54-b8d4-423c-9587-f6bfc66a2271 req-bcd91fb4-7935-40ed-9b14-557a48f5c8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfec6479-6946-4089-be51-fe7aebba3f08", "name": "network-vif-plugged", "status": "completed", "tag": "8aa6eefe-fb90-483e-a3b1-a5304e647ef9"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-8189fc54-b8d4-423c-9587-f6bfc66a2271 req-bcd91fb4-7935-40ed-9b14-557a48f5c8c1 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-8189fc54-b8d4-423c-9587-f6bfc66a2271 req-bcd91fb4-7935-40ed-9b14-557a48f5c8c1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-8189fc54-b8d4-423c-9587-f6bfc66a2271 req-bcd91fb4-7935-40ed-9b14-557a48f5c8c1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:30 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-8189fc54-b8d4-423c-9587-f6bfc66a2271 req-bcd91fb4-7935-40ed-9b14-557a48f5c8c1 service nova] Creating event network-vif-plugged:8aa6eefe-fb90-483e-a3b1-a5304e647ef9 for instance dfec6479-6946-4089-be51-fe7aebba3f08 on user Apr 18 12:57:30 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-8189fc54-b8d4-423c-9587-f6bfc66a2271 req-bcd91fb4-7935-40ed-9b14-557a48f5c8c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037698 Apr 18 12:57:30 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 73/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-99016345"}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:32 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-5f189331-e587-4603-8335-9d4375a7b56a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041/action" status: 202 len: 52 microversion: 2.87 time: 0.890181 Apr 18 12:57:32 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 76/219] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 12:57:32 2023] POST /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041/action => generated 52 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 12:57:32 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:33 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-878c1739-a4c0-4f6a-9c74-1c26b24a25c6 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.235888 Apr 18 12:57:33 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 71/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:32 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:33 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:33 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b258f0bf-acfe-4ecf-9e9a-ec9e440e7eba tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.290241 Apr 18 12:57:33 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 74/221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:33 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:33 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:33 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-6f0b3448-f9b7-4b4f-80ff-37e6d7a380dd tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.244744 Apr 18 12:57:33 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 77/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:33 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:38 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-b6da4114-509e-4aec-936c-39dd2048ac5d tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041" status: 200 len: 1691 microversion: 2.87 time: 0.281577 Apr 18 12:57:38 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 72/223] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:57:38 2023] GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: 68780c76-c582-470e-81ad-6be81909ae02] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=10 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=26 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:47 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:48 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] HTTP exception thrown: Instance 68780c76-c582-470e-81ad-6be81909ae02 could not be found. Apr 18 12:57:48 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Request method failure captured: Apr 18 12:57:48 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02 HTTP/1.1 Apr 18 12:57:48 user devstack@n-api.service[61395]: Accept: application/json Apr 18 12:57:48 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 12:57:48 user devstack@n-api.service[61395]: Connection: close Apr 18 12:57:48 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 12:57:48 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 12:57:48 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 12:57:48 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 12:57:48 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpKYwqh9flmsSBTJRroLFYdnokTQmy5nyeLEffacve34_MQqd7IlwnwHOtetm1hGOZZ8ZX0rZKBFuQaMd5ZUbjcV3FZABOhsOQ0ygkoQH6t96JXrQPUpzH6tepRl3xIle8YdjTiH9oOcHdCQLhUoJAq4p3Z-Zk2vM95kRMsoO-FbV7g Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Project-Id: 4c47472a1a3e4494801cea627fe6cb66 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Project-Name: tempest-VolumesAdminNegativeTest-1065344438 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c47472a1a3e4494801cea627fe6cb66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c47472a1a3e4494801cea627fe6cb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c47472a1a3e4494801cea627fe6cb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Tenant: tempest-VolumesAdminNegativeTest-1065344438 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Tenant-Id: 4c47472a1a3e4494801cea627fe6cb66 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1065344438 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-User: tempest-VolumesAdminNegativeTest-1065344438-project-member Apr 18 12:57:48 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 12:57:48 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 12:57:48 user devstack@n-api.service[61395]: X-User-Id: a37faecb47ed4c8e8dea21ee364164e5 Apr 18 12:57:48 user devstack@n-api.service[61395]: X-User-Name: tempest-VolumesAdminNegativeTest-1065344438-project-member Apr 18 12:57:48 user devstack@n-api.service[61395]: method: > Apr 18 12:57:48 user devstack@n-api.service[61395]: exception: Instance 68780c76-c582-470e-81ad-6be81909ae02 could not be found. Apr 18 12:57:48 user devstack@n-api.service[61395]: action_args: {'id': '68780c76-c582-470e-81ad-6be81909ae02'} Apr 18 12:57:48 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68780c76-c582-470e-81ad-6be81909ae02 could not be found. Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68780c76-c582-470e-81ad-6be81909ae02 could not be found. Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68780c76-c582-470e-81ad-6be81909ae02 could not be found. Apr 18 12:57:48 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:57:48 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Returning 404 to user: Instance 68780c76-c582-470e-81ad-6be81909ae02 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:57:48 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b7062588-3754-476e-9b8c-a9614dbce2b4 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02" status: 404 len: 111 microversion: 2.1 time: 0.044021 Apr 18 12:57:48 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 75/224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:47 2023] GET /compute/v2.1/servers/68780c76-c582-470e-81ad-6be81909ae02 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=8 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:48 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:57:48 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-5b576df0-9600-41af-b87c-20dfe9c5200e tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114" status: 204 len: 0 microversion: 2.1 time: 0.134453 Apr 18 12:57:48 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 78/225] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:57:48 2023] DELETE /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:48 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37faecb47ed4c8e8dea21ee364164e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c47472a1a3e4494801cea627fe6cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:48 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-30f26c0d-5ed2-4a38-a0c2-6c80fba28c86 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114" status: 200 len: 1667 microversion: 2.1 time: 0.246413 Apr 18 12:57:48 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 73/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:48 2023] GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114 => generated 1667 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:48 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-76efc8cc-c0c9-4374-8ed7-6a3553117a8f req-aab3636f-e7ed-4c1c-b371-1c9dfd244d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "name": "network-vif-unplugged", "status": "completed", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:48 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-76efc8cc-c0c9-4374-8ed7-6a3553117a8f req-aab3636f-e7ed-4c1c-b371-1c9dfd244d70 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:48 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-76efc8cc-c0c9-4374-8ed7-6a3553117a8f req-aab3636f-e7ed-4c1c-b371-1c9dfd244d70 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:48 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-76efc8cc-c0c9-4374-8ed7-6a3553117a8f req-aab3636f-e7ed-4c1c-b371-1c9dfd244d70 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:48 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-76efc8cc-c0c9-4374-8ed7-6a3553117a8f req-aab3636f-e7ed-4c1c-b371-1c9dfd244d70 service nova] Creating event network-vif-unplugged:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:57:48 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-76efc8cc-c0c9-4374-8ed7-6a3553117a8f req-aab3636f-e7ed-4c1c-b371-1c9dfd244d70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030924 Apr 18 12:57:48 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 76/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "name": "network-vif-plugged", "status": "completed", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}, {"server_uuid": "af7bc00a-302e-45e4-9565-78bc7b8c1114", "name": "network-vif-deleted", "tag": "b601c11e-4223-42e5-a296-4ec160f574ba"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] Creating event network-vif-plugged:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:57:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] Creating event network-vif-deleted:b601c11e-4223-42e5-a296-4ec160f574ba for instance af7bc00a-302e-45e4-9565-78bc7b8c1114 on user Apr 18 12:57:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-3ac786f9-cf03-4ed3-abdb-1e36f889403c req-31b0424d-845e-4d78-a0d9-3e4ace86b968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029512 Apr 18 12:57:50 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 79/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:57:55 user devstack@n-api.service[61393]: DEBUG nova.objects.instance [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lazy-loading 'flavor' on Instance uuid dddb0813-98a2-4754-baca-9bfff5ed3333 {{(pid=61393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 12:57:56 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-37594782-6ddb-4c31-b255-c4672e5be61c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333/action" status: 200 len: 32 microversion: 2.1 time: 0.144261 Apr 18 12:57:56 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 74/229] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 12:57:55 2023] POST /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:56 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:57:56 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-4a2acb81-227e-4985-ab2c-9e51098e6935 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 200 len: 1509 microversion: 2.1 time: 0.332442 Apr 18 12:57:56 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:57:56 2023] GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:57:57 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-d8d017d0-d22e-48f4-8dca-6574dc88f38d req-8fb8cc9e-7f68-4cf8-b404-c4c2b6aa08d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-unplugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-d8d017d0-d22e-48f4-8dca-6574dc88f38d req-8fb8cc9e-7f68-4cf8-b404-c4c2b6aa08d7 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-d8d017d0-d22e-48f4-8dca-6574dc88f38d req-8fb8cc9e-7f68-4cf8-b404-c4c2b6aa08d7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-d8d017d0-d22e-48f4-8dca-6574dc88f38d req-8fb8cc9e-7f68-4cf8-b404-c4c2b6aa08d7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:57 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-d8d017d0-d22e-48f4-8dca-6574dc88f38d req-8fb8cc9e-7f68-4cf8-b404-c4c2b6aa08d7 service nova] Creating event network-vif-unplugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:57:57 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-d8d017d0-d22e-48f4-8dca-6574dc88f38d req-8fb8cc9e-7f68-4cf8-b404-c4c2b6aa08d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088686 Apr 18 12:57:57 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 80/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:57:59 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-a6d87642-3bfa-473c-9874-c62e5a853ba6 req-41962cb5-8fcf-423e-9090-1d3731787caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-plugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:57:59 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-a6d87642-3bfa-473c-9874-c62e5a853ba6 req-41962cb5-8fcf-423e-9090-1d3731787caf service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:57:59 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-a6d87642-3bfa-473c-9874-c62e5a853ba6 req-41962cb5-8fcf-423e-9090-1d3731787caf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:57:59 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-a6d87642-3bfa-473c-9874-c62e5a853ba6 req-41962cb5-8fcf-423e-9090-1d3731787caf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:57:59 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-a6d87642-3bfa-473c-9874-c62e5a853ba6 req-41962cb5-8fcf-423e-9090-1d3731787caf service nova] Creating event network-vif-plugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:57:59 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-a6d87642-3bfa-473c-9874-c62e5a853ba6 req-41962cb5-8fcf-423e-9090-1d3731787caf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030418 Apr 18 12:57:59 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 75/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:57:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:01 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-plugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}, {"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-plugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] Creating event network-vif-plugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:58:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] Creating event network-vif-plugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 12:58:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-64d0cee4-4bbc-4c01-8034-4db3b6efd889 req-7fb72c43-341c-43ea-b68f-e0e8fb7dc8d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030386 Apr 18 12:58:01 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:10 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:10 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-217dc47f-df33-4c7b-a787-b5af84debec3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 200 len: 1537 microversion: 2.1 time: 0.265761 Apr 18 12:58:10 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 81/234] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:09 2023] GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 1537 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Searching by: {'deleted': False, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780'} {{(pid=61393) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:10 user devstack@n-api.service[61393]: DEBUG nova.compute.multi_cell_list [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61393) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 12:58:10 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-0f96d4dd-8eb3-4691-a72a-d5395c8cb29c tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.070597 Apr 18 12:58:10 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 76/235] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 12:58:10 2023] GET /compute/v2.1/servers => generated 340 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:10 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:10 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b135e28f-cc5d-431a-b5aa-ede9b18965b4 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 200 len: 1537 microversion: 2.1 time: 0.234073 Apr 18 12:58:10 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 79/236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:10 2023] GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:11 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:58:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-b14da240-35f5-4267-84a3-14e8b0da85f3 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 204 len: 0 microversion: 2.1 time: 0.143296 Apr 18 12:58:11 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 82/237] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 12:58:11 2023] DELETE /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:12 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-458c642e-b360-482b-bcda-5d17bf0a8360 req-80faefa1-b757-4e38-94cb-478aae1a3055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb082fc-1009-4af6-a6ce-98ff430f84c4", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b16c98-9245-411b-b6c5-fd20c24b1a03"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:12 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-458c642e-b360-482b-bcda-5d17bf0a8360 req-80faefa1-b757-4e38-94cb-478aae1a3055 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:12 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-458c642e-b360-482b-bcda-5d17bf0a8360 req-80faefa1-b757-4e38-94cb-478aae1a3055 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:12 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-458c642e-b360-482b-bcda-5d17bf0a8360 req-80faefa1-b757-4e38-94cb-478aae1a3055 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:12 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-458c642e-b360-482b-bcda-5d17bf0a8360 req-80faefa1-b757-4e38-94cb-478aae1a3055 service nova] Creating event network-vif-unplugged:e3b16c98-9245-411b-b6c5-fd20c24b1a03 for instance abb082fc-1009-4af6-a6ce-98ff430f84c4 on user Apr 18 12:58:12 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-458c642e-b360-482b-bcda-5d17bf0a8360 req-80faefa1-b757-4e38-94cb-478aae1a3055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123176 Apr 18 12:58:12 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:12 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e7674bd0a24feead88eb5b7338ae99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91be86ea743d46ed9f1e7ed2dcc5a780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-87c43721-131a-4706-ab2b-b8469b35be99 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 200 len: 1543 microversion: 2.1 time: 0.666800 Apr 18 12:58:12 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 77/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:11 2023] GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 1543 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:58:13 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-804a8c4e-6e5c-428f-8167-f36963b4b5e0 req-94a9c96e-0806-4069-b635-1c1baba474ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb082fc-1009-4af6-a6ce-98ff430f84c4", "name": "network-vif-deleted", "tag": "e3b16c98-9245-411b-b6c5-fd20c24b1a03"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-804a8c4e-6e5c-428f-8167-f36963b4b5e0 req-94a9c96e-0806-4069-b635-1c1baba474ac service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-804a8c4e-6e5c-428f-8167-f36963b4b5e0 req-94a9c96e-0806-4069-b635-1c1baba474ac service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-804a8c4e-6e5c-428f-8167-f36963b4b5e0 req-94a9c96e-0806-4069-b635-1c1baba474ac service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-804a8c4e-6e5c-428f-8167-f36963b4b5e0 req-94a9c96e-0806-4069-b635-1c1baba474ac service nova] Creating event network-vif-deleted:e3b16c98-9245-411b-b6c5-fd20c24b1a03 for instance abb082fc-1009-4af6-a6ce-98ff430f84c4 on user Apr 18 12:58:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-804a8c4e-6e5c-428f-8167-f36963b4b5e0 req-94a9c96e-0806-4069-b635-1c1baba474ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079413 Apr 18 12:58:13 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 83/240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:14 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-36465449-a922-4072-9946-25995d335116 req-a1411b03-8cc5-44d6-a50c-723c4b311503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb082fc-1009-4af6-a6ce-98ff430f84c4", "name": "network-vif-plugged", "status": "completed", "tag": "e3b16c98-9245-411b-b6c5-fd20c24b1a03"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-36465449-a922-4072-9946-25995d335116 req-a1411b03-8cc5-44d6-a50c-723c4b311503 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-36465449-a922-4072-9946-25995d335116 req-a1411b03-8cc5-44d6-a50c-723c4b311503 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-36465449-a922-4072-9946-25995d335116 req-a1411b03-8cc5-44d6-a50c-723c4b311503 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:14 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-36465449-a922-4072-9946-25995d335116 req-a1411b03-8cc5-44d6-a50c-723c4b311503 service nova] Creating event network-vif-plugged:e3b16c98-9245-411b-b6c5-fd20c24b1a03 for instance abb082fc-1009-4af6-a6ce-98ff430f84c4 on user Apr 18 12:58:14 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-36465449-a922-4072-9946-25995d335116 req-a1411b03-8cc5-44d6-a50c-723c4b311503 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028316 Apr 18 12:58:14 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] [instance: dfec6479-6946-4089-be51-fe7aebba3f08] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:18 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] HTTP exception thrown: Instance dfec6479-6946-4089-be51-fe7aebba3f08 could not be found. Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Request method failure captured: Apr 18 12:58:18 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 HTTP/1.1 Apr 18 12:58:18 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:58:18 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:58:18 user devstack@n-api.service[61393]: Connection: close Apr 18 12:58:18 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:58:18 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:58:18 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:58:18 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:58:18 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpLTyvYL9aLVVm8BxVtgZ_WC3aZH5swc0Nvr-GCFT-4E_vjn5NwrNvnc-R9SPQLlQB2FKULxkb3l2YXLyiXiFnuUcH1qJARrtaH5PyRVO_rfyH2Vm5ICBcV9RHkjeZp7IFTmbOiu8Cu_Q7sU6ugfeh8atmluWvtw58o-jBtYBhwA1Po Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Project-Id: 67e0b5cb088a4562864d07104be87a9c Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1150294810 Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67e0b5cb088a4562864d07104be87a9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/67e0b5cb088a4562864d07104be87a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67e0b5cb088a4562864d07104be87a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Tenant: tempest-ServerStableDeviceRescueTest-1150294810 Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Tenant-Id: 67e0b5cb088a4562864d07104be87a9c Apr 18 12:58:18 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1150294810 Apr 18 12:58:18 user devstack@n-api.service[61393]: X-User: tempest-ServerStableDeviceRescueTest-1150294810-project-member Apr 18 12:58:18 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:58:18 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:58:18 user devstack@n-api.service[61393]: X-User-Id: 28484fa4ad2e484f9a612941b5d6b335 Apr 18 12:58:18 user devstack@n-api.service[61393]: X-User-Name: tempest-ServerStableDeviceRescueTest-1150294810-project-member Apr 18 12:58:18 user devstack@n-api.service[61393]: method: > Apr 18 12:58:18 user devstack@n-api.service[61393]: exception: Instance dfec6479-6946-4089-be51-fe7aebba3f08 could not be found. Apr 18 12:58:18 user devstack@n-api.service[61393]: action_args: {'id': 'dfec6479-6946-4089-be51-fe7aebba3f08'} Apr 18 12:58:18 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfec6479-6946-4089-be51-fe7aebba3f08 could not be found. Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfec6479-6946-4089-be51-fe7aebba3f08 could not be found. Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfec6479-6946-4089-be51-fe7aebba3f08 could not be found. Apr 18 12:58:18 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:58:18 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Returning 404 to user: Instance dfec6479-6946-4089-be51-fe7aebba3f08 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:58:18 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-18e82415-08ee-4d57-b591-3f2c4d3223fc tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08" status: 404 len: 111 microversion: 2.1 time: 0.027991 Apr 18 12:58:18 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 78/242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:18 2023] GET /compute/v2.1/servers/dfec6479-6946-4089-be51-fe7aebba3f08 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:58:18 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-1a48f6f6-62b3-4007-b356-88ad46aea7fb tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] Calling method '.version_select at 0x7fcf0ceea9e0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:18 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-1a48f6f6-62b3-4007-b356-88ad46aea7fb tempest-ServerStableDeviceRescueTest-1150294810 tempest-ServerStableDeviceRescueTest-1150294810-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954929054" status: 202 len: 0 microversion: 2.1 time: 0.021879 Apr 18 12:58:18 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 84/243] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 12:58:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954929054 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=15 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:20 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=23 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:20 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-891edb77-4162-4d57-987c-8a8c95f71250 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.181709 Apr 18 12:58:20 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 12:58:20 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3/os-interface => generated 283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:58:21 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-297721a3-ac54-4ad1-b321-ec01e4f8d9c5 req-0af00ec2-b875-4b3e-a06e-3ced8a602b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:21 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-297721a3-ac54-4ad1-b321-ec01e4f8d9c5 req-0af00ec2-b875-4b3e-a06e-3ced8a602b1f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-297721a3-ac54-4ad1-b321-ec01e4f8d9c5 req-0af00ec2-b875-4b3e-a06e-3ced8a602b1f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-297721a3-ac54-4ad1-b321-ec01e4f8d9c5 req-0af00ec2-b875-4b3e-a06e-3ced8a602b1f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:21 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-297721a3-ac54-4ad1-b321-ec01e4f8d9c5 req-0af00ec2-b875-4b3e-a06e-3ced8a602b1f service nova] Creating event network-changed:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:58:21 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-297721a3-ac54-4ad1-b321-ec01e4f8d9c5 req-0af00ec2-b875-4b3e-a06e-3ced8a602b1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030939 Apr 18 12:58:21 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 79/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:21 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-90bacad3-d67d-4f4d-86b0-7c581d3350fa tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3/ips" status: 200 len: 110 microversion: 2.20 time: 0.037965 Apr 18 12:58:21 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 85/246] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 12:58:21 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:22 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Going to try to terminate instance {{(pid=61395) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:58:22 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-68da3dc3-e815-4583-a484-1f85d4476e5d tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 204 len: 0 microversion: 2.20 time: 0.115892 Apr 18 12:58:22 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 12:58:22 2023] DELETE /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:22 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6575d954aca4737bb6e943143d434fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2141ea57b3164da2b77659a221c2b3e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c511f4ab-7528-4c68-8f78-4fec6bb8a19b tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 200 len: 1711 microversion: 2.20 time: 0.283933 Apr 18 12:58:22 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 80/248] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:58:22 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 1711 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:58:23 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-39c92529-bb09-4a54-a241-8242c98f0488 req-24457cad-9cc2-453f-9064-9ebc0151f49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "name": "network-vif-unplugged", "status": "completed", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-39c92529-bb09-4a54-a241-8242c98f0488 req-24457cad-9cc2-453f-9064-9ebc0151f49f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-39c92529-bb09-4a54-a241-8242c98f0488 req-24457cad-9cc2-453f-9064-9ebc0151f49f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-39c92529-bb09-4a54-a241-8242c98f0488 req-24457cad-9cc2-453f-9064-9ebc0151f49f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-39c92529-bb09-4a54-a241-8242c98f0488 req-24457cad-9cc2-453f-9064-9ebc0151f49f service nova] Creating event network-vif-unplugged:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:58:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-39c92529-bb09-4a54-a241-8242c98f0488 req-24457cad-9cc2-453f-9064-9ebc0151f49f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028774 Apr 18 12:58:23 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 86/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "name": "network-vif-plugged", "status": "completed", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}, {"server_uuid": "11ac19bc-2428-4416-a99c-5203c19f82a3", "name": "network-vif-deleted", "tag": "d68407d3-0293-4e9b-b597-21342a4c3752"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] Creating event network-vif-plugged:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:58:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] Creating event network-vif-deleted:d68407d3-0293-4e9b-b597-21342a4c3752 for instance 11ac19bc-2428-4416-a99c-5203c19f82a3 on user Apr 18 12:58:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-43488928-8c9b-46c5-a2a3-792cdbe188cb req-bf7090f0-5c6d-4fe6-b004-ae5bd764ed06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029296 Apr 18 12:58:25 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:27 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:27 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-337ca171-baa0-485e-9d0b-a0a959eb2048 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1493 microversion: 2.1 time: 0.353514 Apr 18 12:58:27 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 81/251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:27 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1493 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:58:29 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-962af3b0-a0e2-481b-be5c-ce44a5aaec46 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Action: 'create', calling method: .version_select at 0x7fcf0ceeb520>, body: {"keypair": {"name": "tempest-keypair-1290364724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyC39sThlNwZNVfhUux6zVdwXzYpbvoy+de9FZbDwPkpFszvcXoAqcmmsfN1mT68VJfmt7kaAiIfX5urGrzKcNdS2qh9AhjO109qqnPoIsC+MT7jgjmF0aGmYhSNaaLWA=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:29 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-962af3b0-a0e2-481b-be5c-ce44a5aaec46 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:58:29 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-962af3b0-a0e2-481b-be5c-ce44a5aaec46 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for user 3c9ec5bee5f54903a88a917d6cf955bb and project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:58:29 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-962af3b0-a0e2-481b-be5c-ce44a5aaec46 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159536 Apr 18 12:58:29 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 87/252] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:58:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:30 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1599605232", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b1161c0c-5352-4d95-a8fc-0d1bdb88b6ff"}], "security_groups": [{"name": "tempest-securitygroup--2114741846"}], "key_name": "tempest-keypair-1290364724", "user_data": "}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:30 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] validate_networks() for [('b1161c0c-5352-4d95-a8fc-0d1bdb88b6ff', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for user 3c9ec5bee5f54903a88a917d6cf955bb and project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:58:31 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:58:31 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-01645c22-4c49-4630-a7c0-c4cdbd5a2529 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.733172 Apr 18 12:58:31 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 85/253] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:58:30 2023] POST /compute/v2.1/servers => generated 400 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:58:31 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5dcb9016-d068-4178-88e5-284a12c3754d tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:31 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5dcb9016-d068-4178-88e5-284a12c3754d tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:31 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-5dcb9016-d068-4178-88e5-284a12c3754d tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:31 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5dcb9016-d068-4178-88e5-284a12c3754d tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 200 len: 1236 microversion: 2.1 time: 0.070347 Apr 18 12:58:31 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 82/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:31 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:58:34 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:34 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-7cc21b60-59d0-4ee6-b4e7-230f0c41899c req-dea75e88-4005-415c-8928-0e3e7759bf6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7cc21b60-59d0-4ee6-b4e7-230f0c41899c req-dea75e88-4005-415c-8928-0e3e7759bf6e service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7cc21b60-59d0-4ee6-b4e7-230f0c41899c req-dea75e88-4005-415c-8928-0e3e7759bf6e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:34 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-7cc21b60-59d0-4ee6-b4e7-230f0c41899c req-dea75e88-4005-415c-8928-0e3e7759bf6e service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-7cc21b60-59d0-4ee6-b4e7-230f0c41899c req-dea75e88-4005-415c-8928-0e3e7759bf6e service nova] Creating event network-changed:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 12:58:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-7cc21b60-59d0-4ee6-b4e7-230f0c41899c req-dea75e88-4005-415c-8928-0e3e7759bf6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038985 Apr 18 12:58:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 88/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:35 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:35 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b73c3311-eaf8-476c-a766-dbc3aae91883 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.351237 Apr 18 12:58:35 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:35 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:58:36 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-162d7c69-5aca-4068-b1e9-549d40429887 req-877462f8-fb18-42ac-b3a6-3f1880a4b79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "name": "network-vif-plugged", "status": "completed", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-162d7c69-5aca-4068-b1e9-549d40429887 req-877462f8-fb18-42ac-b3a6-3f1880a4b79a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-162d7c69-5aca-4068-b1e9-549d40429887 req-877462f8-fb18-42ac-b3a6-3f1880a4b79a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-162d7c69-5aca-4068-b1e9-549d40429887 req-877462f8-fb18-42ac-b3a6-3f1880a4b79a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:36 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-162d7c69-5aca-4068-b1e9-549d40429887 req-877462f8-fb18-42ac-b3a6-3f1880a4b79a service nova] Creating event network-vif-plugged:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 12:58:36 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-162d7c69-5aca-4068-b1e9-549d40429887 req-877462f8-fb18-42ac-b3a6-3f1880a4b79a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042387 Apr 18 12:58:36 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 83/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:38 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-426322310", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "51847ea3-3c22-40cf-a9fc-97a5fa333674"}]}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:38 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] validate_networks() for [('51847ea3-3c22-40cf-a9fc-97a5fa333674', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:58:38 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-fbaa9266-13fa-4951-bbb9-86eeaf4d869a req-5feebe7f-fb58-4295-9694-233b1c9dfe12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "name": "network-vif-plugged", "status": "completed", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-fbaa9266-13fa-4951-bbb9-86eeaf4d869a req-5feebe7f-fb58-4295-9694-233b1c9dfe12 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-fbaa9266-13fa-4951-bbb9-86eeaf4d869a req-5feebe7f-fb58-4295-9694-233b1c9dfe12 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-fbaa9266-13fa-4951-bbb9-86eeaf4d869a req-5feebe7f-fb58-4295-9694-233b1c9dfe12 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-fbaa9266-13fa-4951-bbb9-86eeaf4d869a req-5feebe7f-fb58-4295-9694-233b1c9dfe12 service nova] Creating event network-vif-plugged:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 12:58:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-fbaa9266-13fa-4951-bbb9-86eeaf4d869a req-5feebe7f-fb58-4295-9694-233b1c9dfe12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028860 Apr 18 12:58:38 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 84/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] [instance: af7bc00a-302e-45e4-9565-78bc7b8c1114] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:38 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] HTTP exception thrown: Instance af7bc00a-302e-45e4-9565-78bc7b8c1114 could not be found. Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Request method failure captured: Apr 18 12:58:38 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114 HTTP/1.1 Apr 18 12:58:38 user devstack@n-api.service[61395]: Accept: application/json Apr 18 12:58:38 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 12:58:38 user devstack@n-api.service[61395]: Connection: close Apr 18 12:58:38 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 12:58:38 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 12:58:38 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 12:58:38 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 12:58:38 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpKYwqh9flmsSBTJRroLFYdnokTQmy5nyeLEffacve34_MQqd7IlwnwHOtetm1hGOZZ8ZX0rZKBFuQaMd5ZUbjcV3FZABOhsOQ0ygkoQH6t96JXrQPUpzH6tepRl3xIle8YdjTiH9oOcHdCQLhUoJAq4p3Z-Zk2vM95kRMsoO-FbV7g Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Project-Id: 4c47472a1a3e4494801cea627fe6cb66 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Project-Name: tempest-VolumesAdminNegativeTest-1065344438 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c47472a1a3e4494801cea627fe6cb66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c47472a1a3e4494801cea627fe6cb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c47472a1a3e4494801cea627fe6cb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Tenant: tempest-VolumesAdminNegativeTest-1065344438 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Tenant-Id: 4c47472a1a3e4494801cea627fe6cb66 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1065344438 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-User: tempest-VolumesAdminNegativeTest-1065344438-project-member Apr 18 12:58:38 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 12:58:38 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 12:58:38 user devstack@n-api.service[61395]: X-User-Id: a37faecb47ed4c8e8dea21ee364164e5 Apr 18 12:58:38 user devstack@n-api.service[61395]: X-User-Name: tempest-VolumesAdminNegativeTest-1065344438-project-member Apr 18 12:58:38 user devstack@n-api.service[61395]: method: > Apr 18 12:58:38 user devstack@n-api.service[61395]: exception: Instance af7bc00a-302e-45e4-9565-78bc7b8c1114 could not be found. Apr 18 12:58:38 user devstack@n-api.service[61395]: action_args: {'id': 'af7bc00a-302e-45e4-9565-78bc7b8c1114'} Apr 18 12:58:38 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7bc00a-302e-45e4-9565-78bc7b8c1114 could not be found. Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7bc00a-302e-45e4-9565-78bc7b8c1114 could not be found. Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7bc00a-302e-45e4-9565-78bc7b8c1114 could not be found. Apr 18 12:58:38 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:58:38 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Returning 404 to user: Instance af7bc00a-302e-45e4-9565-78bc7b8c1114 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:58:38 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-54f6668e-b34e-41cd-ae1c-f79c4d3d28f3 tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114" status: 404 len: 111 microversion: 2.1 time: 0.165742 Apr 18 12:58:38 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:38 2023] GET /compute/v2.1/servers/af7bc00a-302e-45e4-9565-78bc7b8c1114 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:58:38 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-24a6abbc-857b-475f-98b7-5aa8d3c95bfc tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] Calling method '.version_select at 0x7fcf0cd87490>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:38 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-24a6abbc-857b-475f-98b7-5aa8d3c95bfc tempest-VolumesAdminNegativeTest-1065344438 tempest-VolumesAdminNegativeTest-1065344438-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497184784" status: 202 len: 0 microversion: 2.1 time: 0.020151 Apr 18 12:58:38 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 85/260] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 12:58:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497184784 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for user c85d24916dfd4caba3c62d5a25d4b18f and project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:58:39 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:58:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-82b2ed8c-1755-4af5-b04b-9f009c0db4af tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.628690 Apr 18 12:58:39 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 89/261] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 12:58:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 12:58:39 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-bb5f00a6-470c-4ead-a3aa-b985c602055f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:39 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-bb5f00a6-470c-4ead-a3aa-b985c602055f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:39 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-bb5f00a6-470c-4ead-a3aa-b985c602055f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:39 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-bb5f00a6-470c-4ead-a3aa-b985c602055f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:39 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-bb5f00a6-470c-4ead-a3aa-b985c602055f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:39 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-bb5f00a6-470c-4ead-a3aa-b985c602055f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7" status: 200 len: 1394 microversion: 2.87 time: 0.082293 Apr 18 12:58:39 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 88/262] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:58:39 2023] GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7 => generated 1394 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-aa7cfcdb-2aa8-4c61-b28d-5b7a73bcda97 req-ef11c2cd-6af8-4060-aba3-8fb9f7fa2c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1520a230-366b-497e-99bd-1e4e455b5cb7", "tag": "cf08add0-9b25-4a08-bb78-96e175c7b12d"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-aa7cfcdb-2aa8-4c61-b28d-5b7a73bcda97 req-ef11c2cd-6af8-4060-aba3-8fb9f7fa2c65 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-aa7cfcdb-2aa8-4c61-b28d-5b7a73bcda97 req-ef11c2cd-6af8-4060-aba3-8fb9f7fa2c65 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-aa7cfcdb-2aa8-4c61-b28d-5b7a73bcda97 req-ef11c2cd-6af8-4060-aba3-8fb9f7fa2c65 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:41 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=35 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-aa7cfcdb-2aa8-4c61-b28d-5b7a73bcda97 req-ef11c2cd-6af8-4060-aba3-8fb9f7fa2c65 service nova] Creating event network-changed:cf08add0-9b25-4a08-bb78-96e175c7b12d for instance 1520a230-366b-497e-99bd-1e4e455b5cb7 on user Apr 18 12:58:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-aa7cfcdb-2aa8-4c61-b28d-5b7a73bcda97 req-ef11c2cd-6af8-4060-aba3-8fb9f7fa2c65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041706 Apr 18 12:58:41 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 86/263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:58:44 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-b73a9ece-2553-4afe-8746-d7e65f8a2607 req-44a6ba89-e2b1-4a7e-b4a0-6425e4da726a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1520a230-366b-497e-99bd-1e4e455b5cb7", "name": "network-vif-deleted", "tag": "cf08add0-9b25-4a08-bb78-96e175c7b12d"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:58:44 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:44 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b73a9ece-2553-4afe-8746-d7e65f8a2607 req-44a6ba89-e2b1-4a7e-b4a0-6425e4da726a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:44 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b73a9ece-2553-4afe-8746-d7e65f8a2607 req-44a6ba89-e2b1-4a7e-b4a0-6425e4da726a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:44 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-b73a9ece-2553-4afe-8746-d7e65f8a2607 req-44a6ba89-e2b1-4a7e-b4a0-6425e4da726a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:44 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.compute.server_external_events [req-b73a9ece-2553-4afe-8746-d7e65f8a2607 req-44a6ba89-e2b1-4a7e-b4a0-6425e4da726a service nova] Unable to find a host for instance 1520a230-366b-497e-99bd-1e4e455b5cb7. Dropping event network-vif-deleted {{(pid=61394) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 12:58:44 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-b73a9ece-2553-4afe-8746-d7e65f8a2607 req-44a6ba89-e2b1-4a7e-b4a0-6425e4da726a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035519 Apr 18 12:58:44 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 90/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:58:46 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:58:46 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-35b52202-0165-434d-9437-e934ccd7b31e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 200 len: 1489 microversion: 2.1 time: 0.244597 Apr 18 12:58:46 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:58:46 2023] GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 1489 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=10 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1127813567", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "bacaab2c-f950-40fa-900c-5037fd039f88"}]}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] [instance: abb082fc-1009-4af6-a6ce-98ff430f84c4] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:02 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] validate_networks() for [('bacaab2c-f950-40fa-900c-5037fd039f88', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:59:02 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] HTTP exception thrown: Instance abb082fc-1009-4af6-a6ce-98ff430f84c4 could not be found. Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Request method failure captured: Apr 18 12:59:02 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 HTTP/1.1 Apr 18 12:59:02 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:59:02 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:59:02 user devstack@n-api.service[61393]: Connection: close Apr 18 12:59:02 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:59:02 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:59:02 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:59:02 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:59:02 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpK9jvvalBCHdrunNLT-ToGdwh7Nkb6C4hpciGiySnOzpq0PmQRVdvQjBnBa4_Ij8kyFm7AYiyyUOjyR5DcTn_FIWrBnKyHpYeCRA__t2nfp8IXD54RJhXhkpTFeT0c0z_k_EZDvgQPIHQXna8ldHfxDnhDYz5RQmBnDcodG8sPkH8U Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Project-Id: 91be86ea743d46ed9f1e7ed2dcc5a780 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Project-Name: tempest-TestMinimumBasicScenario-283436028 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91be86ea743d46ed9f1e7ed2dcc5a780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91be86ea743d46ed9f1e7ed2dcc5a780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91be86ea743d46ed9f1e7ed2dcc5a780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Tenant: tempest-TestMinimumBasicScenario-283436028 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Tenant-Id: 91be86ea743d46ed9f1e7ed2dcc5a780 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-TestMinimumBasicScenario-283436028 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-User: tempest-TestMinimumBasicScenario-283436028-project-member Apr 18 12:59:02 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:59:02 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:59:02 user devstack@n-api.service[61393]: X-User-Id: 09e7674bd0a24feead88eb5b7338ae99 Apr 18 12:59:02 user devstack@n-api.service[61393]: X-User-Name: tempest-TestMinimumBasicScenario-283436028-project-member Apr 18 12:59:02 user devstack@n-api.service[61393]: method: > Apr 18 12:59:02 user devstack@n-api.service[61393]: exception: Instance abb082fc-1009-4af6-a6ce-98ff430f84c4 could not be found. Apr 18 12:59:02 user devstack@n-api.service[61393]: action_args: {'id': 'abb082fc-1009-4af6-a6ce-98ff430f84c4'} Apr 18 12:59:02 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb082fc-1009-4af6-a6ce-98ff430f84c4 could not be found. Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb082fc-1009-4af6-a6ce-98ff430f84c4 could not be found. Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb082fc-1009-4af6-a6ce-98ff430f84c4 could not be found. Apr 18 12:59:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Returning 404 to user: Instance abb082fc-1009-4af6-a6ce-98ff430f84c4 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:02 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-cd6a7ce0-411f-476a-bfd9-4b46e459dea9 tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4" status: 404 len: 111 microversion: 2.1 time: 0.188533 Apr 18 12:59:02 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 87/266] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:02 2023] GET /compute/v2.1/servers/abb082fc-1009-4af6-a6ce-98ff430f84c4 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 12:59:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-bb4b54c4-313d-4cc8-9319-1575ecb342cd tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] Calling method '.version_select at 0x7fcf0ce73eb0>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:02 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=8 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:02 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-bb4b54c4-313d-4cc8-9319-1575ecb342cd tempest-TestMinimumBasicScenario-283436028 tempest-TestMinimumBasicScenario-283436028-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2131296057" status: 202 len: 0 microversion: 2.1 time: 0.028113 Apr 18 12:59:02 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 90/267] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 12:59:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2131296057 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Getting quotas for project 9bb6a99f412a417fb58937d0f7baa860. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Getting quotas for user ce977d6c71f34baeae41ae7346e972f4 and project 9bb6a99f412a417fb58937d0f7baa860. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:59:03 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:59:03 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-1a8afb1b-6a37-4b97-96fe-d77eb8e51396 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.595322 Apr 18 12:59:03 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 91/268] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:59:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:59:03 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-4a6b32e0-31eb-4c2d-b87c-569bfdab9aff tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:03 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-4a6b32e0-31eb-4c2d-b87c-569bfdab9aff tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:03 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-4a6b32e0-31eb-4c2d-b87c-569bfdab9aff tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce977d6c71f34baeae41ae7346e972f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb6a99f412a417fb58937d0f7baa860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:03 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-4a6b32e0-31eb-4c2d-b87c-569bfdab9aff tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e" status: 200 len: 1208 microversion: 2.1 time: 0.076069 Apr 18 12:59:03 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 88/269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:03 2023] GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e => generated 1208 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:06 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-e5afcdb3-8757-47bb-b71d-1579944c386f req-c4595001-89f7-4560-8f88-2209134db83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d620928-08c0-4c12-98f0-8689e12c282e", "tag": "7ad2ab36-6497-4d5a-97c3-ed8f199b307c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e5afcdb3-8757-47bb-b71d-1579944c386f req-c4595001-89f7-4560-8f88-2209134db83a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e5afcdb3-8757-47bb-b71d-1579944c386f req-c4595001-89f7-4560-8f88-2209134db83a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e5afcdb3-8757-47bb-b71d-1579944c386f req-c4595001-89f7-4560-8f88-2209134db83a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:06 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-e5afcdb3-8757-47bb-b71d-1579944c386f req-c4595001-89f7-4560-8f88-2209134db83a service nova] Creating event network-changed:7ad2ab36-6497-4d5a-97c3-ed8f199b307c for instance 2d620928-08c0-4c12-98f0-8689e12c282e on user Apr 18 12:59:06 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-e5afcdb3-8757-47bb-b71d-1579944c386f req-c4595001-89f7-4560-8f88-2209134db83a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030263 Apr 18 12:59:06 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:08 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-5234ae67-b53c-4c67-88a5-4f569e89dab1 req-7a111696-3f2a-408d-80f7-2c2723f48943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d620928-08c0-4c12-98f0-8689e12c282e", "name": "network-vif-plugged", "status": "completed", "tag": "7ad2ab36-6497-4d5a-97c3-ed8f199b307c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5234ae67-b53c-4c67-88a5-4f569e89dab1 req-7a111696-3f2a-408d-80f7-2c2723f48943 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5234ae67-b53c-4c67-88a5-4f569e89dab1 req-7a111696-3f2a-408d-80f7-2c2723f48943 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-5234ae67-b53c-4c67-88a5-4f569e89dab1 req-7a111696-3f2a-408d-80f7-2c2723f48943 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:08 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-5234ae67-b53c-4c67-88a5-4f569e89dab1 req-7a111696-3f2a-408d-80f7-2c2723f48943 service nova] Creating event network-vif-plugged:7ad2ab36-6497-4d5a-97c3-ed8f199b307c for instance 2d620928-08c0-4c12-98f0-8689e12c282e on user Apr 18 12:59:08 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-5234ae67-b53c-4c67-88a5-4f569e89dab1 req-7a111696-3f2a-408d-80f7-2c2723f48943 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036922 Apr 18 12:59:08 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 92/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:10 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-35a0de3c-ca14-442c-9fa4-db3daeb4396a req-ee3102d1-aac7-4100-b860-fdaf85d78d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d620928-08c0-4c12-98f0-8689e12c282e", "name": "network-vif-plugged", "status": "completed", "tag": "7ad2ab36-6497-4d5a-97c3-ed8f199b307c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-35a0de3c-ca14-442c-9fa4-db3daeb4396a req-ee3102d1-aac7-4100-b860-fdaf85d78d67 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-35a0de3c-ca14-442c-9fa4-db3daeb4396a req-ee3102d1-aac7-4100-b860-fdaf85d78d67 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-35a0de3c-ca14-442c-9fa4-db3daeb4396a req-ee3102d1-aac7-4100-b860-fdaf85d78d67 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:10 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-35a0de3c-ca14-442c-9fa4-db3daeb4396a req-ee3102d1-aac7-4100-b860-fdaf85d78d67 service nova] Creating event network-vif-plugged:7ad2ab36-6497-4d5a-97c3-ed8f199b307c for instance 2d620928-08c0-4c12-98f0-8689e12c282e on user Apr 18 12:59:10 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-35a0de3c-ca14-442c-9fa4-db3daeb4396a req-ee3102d1-aac7-4100-b860-fdaf85d78d67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Apr 18 12:59:10 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 89/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:13 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] HTTP exception thrown: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Request method failure captured: Apr 18 12:59:13 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 HTTP/1.1 Apr 18 12:59:13 user devstack@n-api.service[61395]: Accept: application/json Apr 18 12:59:13 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 12:59:13 user devstack@n-api.service[61395]: Connection: close Apr 18 12:59:13 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 12:59:13 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 12:59:13 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 12:59:13 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 12:59:13 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpLSjnWOgvJtR5uZ0eIzksf5JHzbIMn-nM_KMFJDK8YqmVs9sxtY1Hhi2oqNgDhyx37Ce7fczv2PhL5sM_bFJACWxOmdYSbVTszh_xtC5WBcf3pqkF2kfDo41pc8bweq7TQivAX6xiDJ-ecb5FgpPTFE1HP4B0ecLp9kKBrbAFfUYUk Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Project-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Tenant-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:13 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:13 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 12:59:13 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 12:59:13 user devstack@n-api.service[61395]: X-User-Id: d6575d954aca4737bb6e943143d434fb Apr 18 12:59:13 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:13 user devstack@n-api.service[61395]: method: > Apr 18 12:59:13 user devstack@n-api.service[61395]: exception: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:13 user devstack@n-api.service[61395]: action_args: {'id': '11ac19bc-2428-4416-a99c-5203c19f82a3'} Apr 18 12:59:13 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:13 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:13 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Returning 404 to user: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:13 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-c6c9ccac-8076-4edf-81c9-330f572e13f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 404 len: 111 microversion: 2.20 time: 0.207066 Apr 18 12:59:13 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 92/273] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:59:12 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:59:13 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-c7e7abe9-fba1-455a-bc83-79b70dd0af95 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '.version_select at 0x7fcf0cee8ee0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-c7e7abe9-fba1-455a-bc83-79b70dd0af95 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061869806" status: 204 len: 0 microversion: 2.20 time: 0.030667 Apr 18 12:59:13 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 93/274] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 12:59:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061869806 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] HTTP exception thrown: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Request method failure captured: Apr 18 12:59:14 user devstack@n-api.service[61393]: request: DELETE /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 HTTP/1.1 Apr 18 12:59:14 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:59:14 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:59:14 user devstack@n-api.service[61393]: Connection: close Apr 18 12:59:14 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:59:14 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:59:14 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:59:14 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:59:14 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpLSjnWOgvJtR5uZ0eIzksf5JHzbIMn-nM_KMFJDK8YqmVs9sxtY1Hhi2oqNgDhyx37Ce7fczv2PhL5sM_bFJACWxOmdYSbVTszh_xtC5WBcf3pqkF2kfDo41pc8bweq7TQivAX6xiDJ-ecb5FgpPTFE1HP4B0ecLp9kKBrbAFfUYUk Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Tenant-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Id: d6575d954aca4737bb6e943143d434fb Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61393]: method: > Apr 18 12:59:14 user devstack@n-api.service[61393]: exception: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: action_args: {'id': '11ac19bc-2428-4416-a99c-5203c19f82a3'} Apr 18 12:59:14 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Returning 404 to user: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:14 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-f3ac7bd9-7149-40d2-91ad-8ce2099c56de tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 404 len: 111 microversion: 2.20 time: 0.039042 Apr 18 12:59:14 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 90/275] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 12:59:14 2023] DELETE /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: 11ac19bc-2428-4416-a99c-5203c19f82a3] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] HTTP exception thrown: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Request method failure captured: Apr 18 12:59:14 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 HTTP/1.1 Apr 18 12:59:14 user devstack@n-api.service[61395]: Accept: application/json Apr 18 12:59:14 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 12:59:14 user devstack@n-api.service[61395]: Connection: close Apr 18 12:59:14 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 12:59:14 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 12:59:14 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 12:59:14 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 12:59:14 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpLSjnWOgvJtR5uZ0eIzksf5JHzbIMn-nM_KMFJDK8YqmVs9sxtY1Hhi2oqNgDhyx37Ce7fczv2PhL5sM_bFJACWxOmdYSbVTszh_xtC5WBcf3pqkF2kfDo41pc8bweq7TQivAX6xiDJ-ecb5FgpPTFE1HP4B0ecLp9kKBrbAFfUYUk Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Project-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Tenant-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61395]: X-User-Id: d6575d954aca4737bb6e943143d434fb Apr 18 12:59:14 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61395]: method: > Apr 18 12:59:14 user devstack@n-api.service[61395]: exception: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61395]: action_args: {'id': '11ac19bc-2428-4416-a99c-5203c19f82a3'} Apr 18 12:59:14 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. Apr 18 12:59:14 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Returning 404 to user: Instance 11ac19bc-2428-4416-a99c-5203c19f82a3 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:14 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-84f45839-5998-4b6f-a108-3d8836ff5cfb tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3" status: 404 len: 111 microversion: 2.20 time: 0.029352 Apr 18 12:59:14 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:59:14 2023] GET /compute/v2.1/servers/11ac19bc-2428-4416-a99c-5203c19f82a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] HTTP exception thrown: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Request method failure captured: Apr 18 12:59:14 user devstack@n-api.service[61394]: request: DELETE /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc HTTP/1.1 Apr 18 12:59:14 user devstack@n-api.service[61394]: Accept: application/json Apr 18 12:59:14 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 12:59:14 user devstack@n-api.service[61394]: Connection: close Apr 18 12:59:14 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 12:59:14 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 12:59:14 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 12:59:14 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 12:59:14 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpLSjnWOgvJtR5uZ0eIzksf5JHzbIMn-nM_KMFJDK8YqmVs9sxtY1Hhi2oqNgDhyx37Ce7fczv2PhL5sM_bFJACWxOmdYSbVTszh_xtC5WBcf3pqkF2kfDo41pc8bweq7TQivAX6xiDJ-ecb5FgpPTFE1HP4B0ecLp9kKBrbAFfUYUk Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Project-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Tenant-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61394]: X-User-Id: d6575d954aca4737bb6e943143d434fb Apr 18 12:59:14 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61394]: method: > Apr 18 12:59:14 user devstack@n-api.service[61394]: exception: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61394]: action_args: {'id': 'ee1d533c-0371-4785-9d2e-163994acd8bc'} Apr 18 12:59:14 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Returning 404 to user: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:14 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-a2e4415e-9ac0-42c3-8827-a429645d3070 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 404 len: 111 microversion: 2.20 time: 0.032897 Apr 18 12:59:14 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 94/277] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 12:59:14 2023] DELETE /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] [instance: ee1d533c-0371-4785-9d2e-163994acd8bc] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:14 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] HTTP exception thrown: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Request method failure captured: Apr 18 12:59:14 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc HTTP/1.1 Apr 18 12:59:14 user devstack@n-api.service[61393]: Accept: application/json Apr 18 12:59:14 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 12:59:14 user devstack@n-api.service[61393]: Connection: close Apr 18 12:59:14 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 12:59:14 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 12:59:14 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 12:59:14 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 12:59:14 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpLSjnWOgvJtR5uZ0eIzksf5JHzbIMn-nM_KMFJDK8YqmVs9sxtY1Hhi2oqNgDhyx37Ce7fczv2PhL5sM_bFJACWxOmdYSbVTszh_xtC5WBcf3pqkF2kfDo41pc8bweq7TQivAX6xiDJ-ecb5FgpPTFE1HP4B0ecLp9kKBrbAFfUYUk Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2141ea57b3164da2b77659a221c2b3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Tenant-Id: 2141ea57b3164da2b77659a221c2b3e5 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-103533962 Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Id: d6575d954aca4737bb6e943143d434fb Apr 18 12:59:14 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-103533962-project-member Apr 18 12:59:14 user devstack@n-api.service[61393]: method: > Apr 18 12:59:14 user devstack@n-api.service[61393]: exception: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: action_args: {'id': 'ee1d533c-0371-4785-9d2e-163994acd8bc'} Apr 18 12:59:14 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. Apr 18 12:59:14 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 12:59:14 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] Returning 404 to user: Instance ee1d533c-0371-4785-9d2e-163994acd8bc could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:14 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-29a6ea91-577f-4b2b-a5f6-d379348695f3 tempest-AttachVolumeShelveTestJSON-103533962 tempest-AttachVolumeShelveTestJSON-103533962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc" status: 404 len: 111 microversion: 2.20 time: 0.031592 Apr 18 12:59:14 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 91/278] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:59:14 2023] GET /compute/v2.1/servers/ee1d533c-0371-4785-9d2e-163994acd8bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:21 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:21 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-09117b06-6b82-4036-870f-53f847431c4f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 200 len: 1546 microversion: 2.1 time: 0.360333 Apr 18 12:59:21 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:21 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 1546 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:26 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:26 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:26 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-e1e45fcf-a836-4dbe-b075-f5a04ac940c1 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Action: 'create', calling method: .version_select at 0x7fcf0ceeadd0>, body: {"keypair": {"name": "tempest-keypair-1118060509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvp153uNk7ZhXDlYyLMrWeRyEgIn+b8ePK7KVxVktmix5C4U+60Z042wJxwS85By5dMyXyr3Ivk7xkSj79wlfdMIucVF+j3wWZ/vojv/X6joLjUBpNS43mndRrgbIfTKA=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:26 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-e1e45fcf-a836-4dbe-b075-f5a04ac940c1 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for project 9fd0e11306684aa891b435589dafe377. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:59:26 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-e1e45fcf-a836-4dbe-b075-f5a04ac940c1 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for user 50769941c80e49539e5a6b8b027c0463 and project 9fd0e11306684aa891b435589dafe377. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:59:26 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-e1e45fcf-a836-4dbe-b075-f5a04ac940c1 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220288 Apr 18 12:59:26 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 95/280] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:59:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:27 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-299935602", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f41e5c26-b25d-4d76-af4d-048f7fe24c00"}], "security_groups": [{"name": "tempest-securitygroup--419532981"}], "key_name": "tempest-keypair-1118060509", "user_data": "}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:27 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=12 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:27 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=9 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:27 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] validate_networks() for [('f41e5c26-b25d-4d76-af4d-048f7fe24c00', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:59:28 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:28 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-004c8928-ab35-4fb9-a284-9c5d21610c7b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1493 microversion: 2.1 time: 0.275394 Apr 18 12:59:28 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:27 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1493 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for project 9fd0e11306684aa891b435589dafe377. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for user 50769941c80e49539e5a6b8b027c0463 and project 9fd0e11306684aa891b435589dafe377. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:59:28 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:59:28 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-a1f29aa6-0d22-4958-83df-824b30433c20 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.759216 Apr 18 12:59:28 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 92/282] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 12:59:27 2023] POST /compute/v2.1/servers => generated 399 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 12:59:28 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-5e975b56-0a42-4aaf-9e9f-b97f142da528 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:28 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-5e975b56-0a42-4aaf-9e9f-b97f142da528 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:28 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-5e975b56-0a42-4aaf-9e9f-b97f142da528 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50769941c80e49539e5a6b8b027c0463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd0e11306684aa891b435589dafe377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:28 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-5e975b56-0a42-4aaf-9e9f-b97f142da528 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 200 len: 1231 microversion: 2.1 time: 0.066027 Apr 18 12:59:28 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 96/283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:28 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 1231 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG nova.objects.instance [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lazy-loading 'fault' on Instance uuid 1520a230-366b-497e-99bd-1e4e455b5cb7 {{(pid=61395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:29 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:29 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-a825b99f-0956-4022-b038-11f81f80caa6 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7" status: 200 len: 1649 microversion: 2.87 time: 0.143488 Apr 18 12:59:29 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 96/284] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:59:29 2023] GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7 => generated 1649 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Doing local delete in cell 8e2e7804-6c25-4b7a-b3e8-114c55cd91bc(cell1) {{(pid=61393) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:29 user devstack@n-api.service[61393]: WARNING nova.compute.api [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] instance's host None is down, deleting from database Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] deallocate_for_instance() {{(pid=61393) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Instance cache missing network info. {{(pid=61393) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Updating instance_info_cache with network_info: [] {{(pid=61393) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 12:59:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61393) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 12:59:29 user devstack@n-api.service[61393]: WARNING nova.compute.api [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 12:59:30 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8d732aca-91e7-4c96-929f-0c198e9eb51a tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7" status: 204 len: 0 microversion: 2.87 time: 0.537668 Apr 18 12:59:30 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 93/285] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 12:59:29 2023] DELETE /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 1520a230-366b-497e-99bd-1e4e455b5cb7] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] HTTP exception thrown: Instance 1520a230-366b-497e-99bd-1e4e455b5cb7 could not be found. Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Request method failure captured: Apr 18 12:59:30 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7 HTTP/1.1 Apr 18 12:59:30 user devstack@n-api.service[61394]: Accept: application/json Apr 18 12:59:30 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 12:59:30 user devstack@n-api.service[61394]: Connection: close Apr 18 12:59:30 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 12:59:30 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 12:59:30 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 12:59:30 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 12:59:30 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpNMJXD0HO-FgJ0YHuBBOw0Fkzec-KZtPL4V3azLWHYng0lT6miJyjmxwcD3UU2nDXkkSoXpiVastnq2zCMgI-I87tErg_OrFHpyLKm0X6ePQBY4ZKqYOkUEPIwTwfxgoUZq8SZRrXHLO5okLUTkPdbyZ16m_iLRM3MhR1rske4bXCk Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Project-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Tenant-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 12:59:30 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 12:59:30 user devstack@n-api.service[61394]: X-User: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 12:59:30 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 12:59:30 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 12:59:30 user devstack@n-api.service[61394]: X-User-Id: c85d24916dfd4caba3c62d5a25d4b18f Apr 18 12:59:30 user devstack@n-api.service[61394]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 12:59:30 user devstack@n-api.service[61394]: method: > Apr 18 12:59:30 user devstack@n-api.service[61394]: exception: Instance 1520a230-366b-497e-99bd-1e4e455b5cb7 could not be found. Apr 18 12:59:30 user devstack@n-api.service[61394]: action_args: {'id': '1520a230-366b-497e-99bd-1e4e455b5cb7'} Apr 18 12:59:30 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1520a230-366b-497e-99bd-1e4e455b5cb7 could not be found. Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1520a230-366b-497e-99bd-1e4e455b5cb7 could not be found. Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1520a230-366b-497e-99bd-1e4e455b5cb7 could not be found. Apr 18 12:59:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Returning 404 to user: Instance 1520a230-366b-497e-99bd-1e4e455b5cb7 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 12:59:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-295fb520-c27d-4aa9-bf54-e2e52fc7a54c tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7" status: 404 len: 111 microversion: 2.87 time: 0.031575 Apr 18 12:59:30 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 97/286] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:59:30 2023] GET /compute/v2.1/servers/1520a230-366b-497e-99bd-1e4e455b5cb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1039393265", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "networks": [{"uuid": "51847ea3-3c22-40cf-a9fc-97a5fa333674"}]}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] validate_networks() for [('51847ea3-3c22-40cf-a9fc-97a5fa333674', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for user c85d24916dfd4caba3c62d5a25d4b18f and project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 12:59:30 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 12:59:30 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-34e3e9fa-9b95-4356-88e9-385f5776d462 tempest-TestVolumeBootPattern-194264362 tempest-TestVolumeBootPattern-194264362-project-member] Action: 'create', calling method: .version_select at 0x7fcf0ccad510>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-189229523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg7QZbc/maj4KZuJyQNoE0QVSEuCkua5s7Ye/SHlP07iX1l9X9TZDkpM/qR1pTORuP0nabiEeuUN9EsLt7LmAgzV9SC9zMm9o/IrLHH6zFQdwe9LfLNRSu6Pm7rVMM98A=="}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:30 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-34e3e9fa-9b95-4356-88e9-385f5776d462 tempest-TestVolumeBootPattern-194264362 tempest-TestVolumeBootPattern-194264362-project-member] Getting quotas for project 1557dc9a810e4e0d9c4c24e1395cb5b3. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 12:59:30 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-f7ce5562-0ee4-4f34-81cf-57cf5a59b3d0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.602878 Apr 18 12:59:30 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 97/287] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 12:59:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 12:59:30 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-34e3e9fa-9b95-4356-88e9-385f5776d462 tempest-TestVolumeBootPattern-194264362 tempest-TestVolumeBootPattern-194264362-project-member] Getting quotas for user 874f622cedf045d5b6b60c4d0aa0a755 and project 1557dc9a810e4e0d9c4c24e1395cb5b3. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-5ec4a287-95e6-4be3-a14f-cb33e8f69e31 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-5ec4a287-95e6-4be3-a14f-cb33e8f69e31 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:30 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-34e3e9fa-9b95-4356-88e9-385f5776d462 tempest-TestVolumeBootPattern-194264362 tempest-TestVolumeBootPattern-194264362-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.045118 Apr 18 12:59:30 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 94/288] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 12:59:30 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-5ec4a287-95e6-4be3-a14f-cb33e8f69e31 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-5ec4a287-95e6-4be3-a14f-cb33e8f69e31 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:30 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-5ec4a287-95e6-4be3-a14f-cb33e8f69e31 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-5ec4a287-95e6-4be3-a14f-cb33e8f69e31 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d" status: 200 len: 1395 microversion: 2.87 time: 0.094416 Apr 18 12:59:30 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 98/289] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 12:59:30 2023] GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d => generated 1395 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 12:59:31 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-ad07b4c0-9f4c-4ffd-abc3-2e854546e342 req-614daa0f-2d9f-4f9b-9365-f41faf7632e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-ad07b4c0-9f4c-4ffd-abc3-2e854546e342 req-614daa0f-2d9f-4f9b-9365-f41faf7632e2 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-ad07b4c0-9f4c-4ffd-abc3-2e854546e342 req-614daa0f-2d9f-4f9b-9365-f41faf7632e2 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-ad07b4c0-9f4c-4ffd-abc3-2e854546e342 req-614daa0f-2d9f-4f9b-9365-f41faf7632e2 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:31 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-ad07b4c0-9f4c-4ffd-abc3-2e854546e342 req-614daa0f-2d9f-4f9b-9365-f41faf7632e2 service nova] Creating event network-changed:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 12:59:31 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-ad07b4c0-9f4c-4ffd-abc3-2e854546e342 req-614daa0f-2d9f-4f9b-9365-f41faf7632e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027791 Apr 18 12:59:31 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:33 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-0d188869-0558-48b8-9497-dcc23971f73b req-71246799-0feb-43c8-a2f8-564aa1a6c3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b73b48-5c5d-4c77-88e0-3c473f659d6d", "tag": "9ef84274-d3ad-4c78-9e5f-c6b4ce02176c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:33 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-0d188869-0558-48b8-9497-dcc23971f73b req-71246799-0feb-43c8-a2f8-564aa1a6c3cf service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:33 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-0d188869-0558-48b8-9497-dcc23971f73b req-71246799-0feb-43c8-a2f8-564aa1a6c3cf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:33 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-0d188869-0558-48b8-9497-dcc23971f73b req-71246799-0feb-43c8-a2f8-564aa1a6c3cf service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:33 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-0d188869-0558-48b8-9497-dcc23971f73b req-71246799-0feb-43c8-a2f8-564aa1a6c3cf service nova] Creating event network-changed:9ef84274-d3ad-4c78-9e5f-c6b4ce02176c for instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d on user Apr 18 12:59:33 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-0d188869-0558-48b8-9497-dcc23971f73b req-71246799-0feb-43c8-a2f8-564aa1a6c3cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035198 Apr 18 12:59:33 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 95/291] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:34 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d00a860e-9d55-4c67-b9b0-2f86aee9f5bc tempest-TestVolumeBootPattern-194264362 tempest-TestVolumeBootPattern-194264362-project-member] Calling method '.version_select at 0x7fcf0cd61480>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:34 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-d00a860e-9d55-4c67-b9b0-2f86aee9f5bc tempest-TestVolumeBootPattern-194264362 tempest-TestVolumeBootPattern-194264362-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-189229523" status: 202 len: 0 microversion: 2.1 time: 0.021068 Apr 18 12:59:34 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 99/292] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Apr 18 12:59:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-189229523 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=31 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:35 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "name": "network-vif-plugged", "status": "completed", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}, {"server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "name": "network-vif-plugged", "status": "completed", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:35 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:35 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:35 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:35 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] Creating event network-vif-plugged:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 12:59:35 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] Creating event network-vif-plugged:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 12:59:35 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-b27aede9-8e42-4536-9128-3048f3b6efb8 req-cae272ff-dc14-43e5-95c8-93cd78ddd8d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029805 Apr 18 12:59:35 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 96/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:35 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:35 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-f8a527a9-df42-45be-ad14-525039e94cec tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.390006 Apr 18 12:59:35 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:35 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:35 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:36 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:36 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-f5d531f3-b0dc-48c1-9b52-37c5e31b6550 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.250616 Apr 18 12:59:36 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 100/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:35 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:36 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-4c27b90b-a0d5-4cb6-9129-291e080f39ef req-4d839257-097c-481f-a6bc-72c2ff0835b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b73b48-5c5d-4c77-88e0-3c473f659d6d", "name": "network-vif-plugged", "status": "completed", "tag": "9ef84274-d3ad-4c78-9e5f-c6b4ce02176c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4c27b90b-a0d5-4cb6-9129-291e080f39ef req-4d839257-097c-481f-a6bc-72c2ff0835b4 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4c27b90b-a0d5-4cb6-9129-291e080f39ef req-4d839257-097c-481f-a6bc-72c2ff0835b4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:36 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-4c27b90b-a0d5-4cb6-9129-291e080f39ef req-4d839257-097c-481f-a6bc-72c2ff0835b4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:36 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-4c27b90b-a0d5-4cb6-9129-291e080f39ef req-4d839257-097c-481f-a6bc-72c2ff0835b4 service nova] Creating event network-vif-plugged:9ef84274-d3ad-4c78-9e5f-c6b4ce02176c for instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d on user Apr 18 12:59:36 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-4c27b90b-a0d5-4cb6-9129-291e080f39ef req-4d839257-097c-481f-a6bc-72c2ff0835b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Apr 18 12:59:36 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 100/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:36 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:36 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-cb92cd81-8b86-449d-8536-ff00cadc0930 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.297668 Apr 18 12:59:36 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 97/297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:36 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:38 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-8fa1c494-f0af-4568-aed1-1e222677fedb req-17366dc2-26e9-42d9-9636-8d9deb084147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b73b48-5c5d-4c77-88e0-3c473f659d6d", "name": "network-vif-plugged", "status": "completed", "tag": "9ef84274-d3ad-4c78-9e5f-c6b4ce02176c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 12:59:38 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8fa1c494-f0af-4568-aed1-1e222677fedb req-17366dc2-26e9-42d9-9636-8d9deb084147 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:38 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8fa1c494-f0af-4568-aed1-1e222677fedb req-17366dc2-26e9-42d9-9636-8d9deb084147 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:38 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8fa1c494-f0af-4568-aed1-1e222677fedb req-17366dc2-26e9-42d9-9636-8d9deb084147 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:38 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-8fa1c494-f0af-4568-aed1-1e222677fedb req-17366dc2-26e9-42d9-9636-8d9deb084147 service nova] Creating event network-vif-plugged:9ef84274-d3ad-4c78-9e5f-c6b4ce02176c for instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d on user Apr 18 12:59:38 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-8fa1c494-f0af-4568-aed1-1e222677fedb req-17366dc2-26e9-42d9-9636-8d9deb084147 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Apr 18 12:59:38 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 101/298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 12:59:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=3 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=7 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:46 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:47 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:47 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-8998a496-2214-4eeb-b68f-08072e613b2e tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06" status: 200 len: 1502 microversion: 2.1 time: 0.256288 Apr 18 12:59:47 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:46 2023] GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=10 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 12:59:53 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce977d6c71f34baeae41ae7346e972f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb6a99f412a417fb58937d0f7baa860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 12:59:53 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-1a0d68ed-f822-4d68-8173-65ae089e95f2 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e" status: 200 len: 1485 microversion: 2.1 time: 0.220840 Apr 18 12:59:53 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 98/300] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 12:59:53 2023] GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e => generated 1485 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=8 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=10 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:19 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50769941c80e49539e5a6b8b027c0463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd0e11306684aa891b435589dafe377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:19 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-460959c8-ebe4-482b-ad94-7fa19214ad0f tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 200 len: 1536 microversion: 2.1 time: 0.546477 Apr 18 13:00:19 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 102/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:00:18 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 1536 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:21 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:21 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:21 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:21 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e6cc754d-6e5f-4633-85f7-ddefeea55a6f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d" status: 200 len: 1691 microversion: 2.87 time: 0.253445 Apr 18 13:00:21 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 102/302] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:00:20 2023] GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=6 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-57dc4927-13fe-4765-9cdb-045a053628fa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.170235 Apr 18 13:00:22 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 99/303] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 13:00:22 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7/os-interface => generated 282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:23 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-4cf9edb4-abbc-4b24-94dd-69c474004825 req-a534eb5b-0f35-46dc-aa07-dee2e31e1f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-4cf9edb4-abbc-4b24-94dd-69c474004825 req-a534eb5b-0f35-46dc-aa07-dee2e31e1f36 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-4cf9edb4-abbc-4b24-94dd-69c474004825 req-a534eb5b-0f35-46dc-aa07-dee2e31e1f36 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-4cf9edb4-abbc-4b24-94dd-69c474004825 req-a534eb5b-0f35-46dc-aa07-dee2e31e1f36 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-4cf9edb4-abbc-4b24-94dd-69c474004825 req-a534eb5b-0f35-46dc-aa07-dee2e31e1f36 service nova] Creating event network-changed:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 13:00:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-4cf9edb4-abbc-4b24-94dd-69c474004825 req-a534eb5b-0f35-46dc-aa07-dee2e31e1f36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029042 Apr 18 13:00:23 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 103/304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:23 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-0d382bcd-11e7-4f3f-a558-f07e76ba8a05 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7/ips" status: 200 len: 108 microversion: 2.1 time: 0.036760 Apr 18 13:00:23 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:00:23 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:24 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:00:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c70ad6ed-26c7-49e9-811b-793fc75a2a67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 204 len: 0 microversion: 2.1 time: 0.121881 Apr 18 13:00:25 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 100/306] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:00:24 2023] DELETE /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:25 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-729e1c46-26c0-4e85-9b94-f753e41de3ea req-477a26f1-1d3a-44c7-aeb1-6183184d67dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:25 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-729e1c46-26c0-4e85-9b94-f753e41de3ea req-477a26f1-1d3a-44c7-aeb1-6183184d67dc service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-729e1c46-26c0-4e85-9b94-f753e41de3ea req-477a26f1-1d3a-44c7-aeb1-6183184d67dc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:25 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-729e1c46-26c0-4e85-9b94-f753e41de3ea req-477a26f1-1d3a-44c7-aeb1-6183184d67dc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:25 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-447e7098-fe2f-4426-8e5c-af5db34378c7 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 200 len: 1671 microversion: 2.1 time: 0.264686 Apr 18 13:00:25 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 104/307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:00:25 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 1671 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-729e1c46-26c0-4e85-9b94-f753e41de3ea req-477a26f1-1d3a-44c7-aeb1-6183184d67dc service nova] Creating event network-vif-unplugged:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 13:00:25 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-729e1c46-26c0-4e85-9b94-f753e41de3ea req-477a26f1-1d3a-44c7-aeb1-6183184d67dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029050 Apr 18 13:00:25 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 104/308] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:27 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "name": "network-vif-plugged", "status": "completed", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}, {"server_uuid": "bccb0d4d-97d7-499f-8def-63ac33c430e7", "name": "network-vif-deleted", "tag": "8bc36faf-d11f-4ddf-8e75-a3ab26a1b865"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:27 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:27 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] Creating event network-vif-plugged:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 13:00:27 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] Creating event network-vif-deleted:8bc36faf-d11f-4ddf-8e75-a3ab26a1b865 for instance bccb0d4d-97d7-499f-8def-63ac33c430e7 on user Apr 18 13:00:27 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-e9c0e278-5a0f-4033-b7d0-6281c7030032 req-23a142b4-55e8-4d35-8ad3-94119646cc2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032301 Apr 18 13:00:27 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 101/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:29 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:29 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-90c645ae-b14b-4bb4-bab4-33b0b1caedff tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1493 microversion: 2.1 time: 0.218235 Apr 18 13:00:29 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 105/310] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:00:29 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1493 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=8 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=12 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:38 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:38 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-4cb9ee72-5520-45d7-84aa-f43176365a4c tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1657 microversion: 2.1 time: 0.246479 Apr 18 13:00:38 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 105/311] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:00:38 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1657 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:50 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:00:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-aa04c8b4-ae00-4001-b3df-191bec6e50b1 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 204 len: 0 microversion: 2.1 time: 0.129107 Apr 18 13:00:50 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 102/312] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:00:50 2023] DELETE /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=8 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=20 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-9ee12455-d1be-41b7-9993-b741f04c6320 req-88dc3613-7252-4e20-92c9-31b6bc99f1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-unplugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:50 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:50 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:00:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9ee12455-d1be-41b7-9993-b741f04c6320 req-88dc3613-7252-4e20-92c9-31b6bc99f1b4 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9ee12455-d1be-41b7-9993-b741f04c6320 req-88dc3613-7252-4e20-92c9-31b6bc99f1b4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9ee12455-d1be-41b7-9993-b741f04c6320 req-88dc3613-7252-4e20-92c9-31b6bc99f1b4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:50 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-9ee12455-d1be-41b7-9993-b741f04c6320 req-88dc3613-7252-4e20-92c9-31b6bc99f1b4 service nova] Creating event network-vif-unplugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 13:00:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-9ee12455-d1be-41b7-9993-b741f04c6320 req-88dc3613-7252-4e20-92c9-31b6bc99f1b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031658 Apr 18 13:00:50 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 106/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-942a3799-3627-4a6c-9ade-5026051d92bb tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 200 len: 1495 microversion: 2.1 time: 0.271877 Apr 18 13:00:50 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 106/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:00:50 2023] GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 1495 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:51 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-ea1a057c-cd79-4f68-8515-4363909b3ed6 req-eaa60a30-2f61-48de-8a67-826923e08b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-deleted", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:51 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-ea1a057c-cd79-4f68-8515-4363909b3ed6 req-eaa60a30-2f61-48de-8a67-826923e08b3a service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:51 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-ea1a057c-cd79-4f68-8515-4363909b3ed6 req-eaa60a30-2f61-48de-8a67-826923e08b3a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:51 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-ea1a057c-cd79-4f68-8515-4363909b3ed6 req-eaa60a30-2f61-48de-8a67-826923e08b3a service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:51 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-ea1a057c-cd79-4f68-8515-4363909b3ed6 req-eaa60a30-2f61-48de-8a67-826923e08b3a service nova] Creating event network-vif-deleted:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 13:00:51 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-ea1a057c-cd79-4f68-8515-4363909b3ed6 req-eaa60a30-2f61-48de-8a67-826923e08b3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 Apr 18 13:00:51 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 103/315] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:52 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-9f2d009d-be0b-4b43-a8dc-a0257cb68d5c req-4d77d40e-5153-4d17-b254-df0126667cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb0813-98a2-4754-baca-9bfff5ed3333", "name": "network-vif-plugged", "status": "completed", "tag": "cc21d92b-79f6-4d5e-80b6-ca2a15135e1c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9f2d009d-be0b-4b43-a8dc-a0257cb68d5c req-4d77d40e-5153-4d17-b254-df0126667cf9 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9f2d009d-be0b-4b43-a8dc-a0257cb68d5c req-4d77d40e-5153-4d17-b254-df0126667cf9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:52 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9f2d009d-be0b-4b43-a8dc-a0257cb68d5c req-4d77d40e-5153-4d17-b254-df0126667cf9 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:52 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-9f2d009d-be0b-4b43-a8dc-a0257cb68d5c req-4d77d40e-5153-4d17-b254-df0126667cf9 service nova] Creating event network-vif-plugged:cc21d92b-79f6-4d5e-80b6-ca2a15135e1c for instance dddb0813-98a2-4754-baca-9bfff5ed3333 on user Apr 18 13:00:52 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-9f2d009d-be0b-4b43-a8dc-a0257cb68d5c req-4d77d40e-5153-4d17-b254-df0126667cf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 Apr 18 13:00:52 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 107/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:55 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:00:55 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-6793e580-8649-4a98-9738-48850b09e29f tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e" status: 204 len: 0 microversion: 2.1 time: 0.119856 Apr 18 13:00:55 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 107/317] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:00:55 2023] DELETE /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:55 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce977d6c71f34baeae41ae7346e972f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bb6a99f412a417fb58937d0f7baa860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:00:55 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-6bda6128-0d85-4f69-935e-c46210d731f6 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e" status: 200 len: 1491 microversion: 2.1 time: 0.321450 Apr 18 13:00:55 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 104/318] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:00:55 2023] GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e => generated 1491 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:00:55 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-223f0702-daf4-41c2-92f3-245056aa7cdc req-7ed1f7b3-ccb9-4e94-83a4-41035528732b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d620928-08c0-4c12-98f0-8689e12c282e", "name": "network-vif-unplugged", "status": "completed", "tag": "7ad2ab36-6497-4d5a-97c3-ed8f199b307c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-223f0702-daf4-41c2-92f3-245056aa7cdc req-7ed1f7b3-ccb9-4e94-83a4-41035528732b service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-223f0702-daf4-41c2-92f3-245056aa7cdc req-7ed1f7b3-ccb9-4e94-83a4-41035528732b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-223f0702-daf4-41c2-92f3-245056aa7cdc req-7ed1f7b3-ccb9-4e94-83a4-41035528732b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-223f0702-daf4-41c2-92f3-245056aa7cdc req-7ed1f7b3-ccb9-4e94-83a4-41035528732b service nova] Creating event network-vif-unplugged:7ad2ab36-6497-4d5a-97c3-ed8f199b307c for instance 2d620928-08c0-4c12-98f0-8689e12c282e on user Apr 18 13:00:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-223f0702-daf4-41c2-92f3-245056aa7cdc req-7ed1f7b3-ccb9-4e94-83a4-41035528732b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030603 Apr 18 13:00:55 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 108/319] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:56 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-da88e8db-8dac-47c2-afa9-238beb6f09b2 req-c96ee1ce-ed62-4006-b511-f0bf39c7a3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d620928-08c0-4c12-98f0-8689e12c282e", "name": "network-vif-deleted", "tag": "7ad2ab36-6497-4d5a-97c3-ed8f199b307c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:56 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-da88e8db-8dac-47c2-afa9-238beb6f09b2 req-c96ee1ce-ed62-4006-b511-f0bf39c7a3d0 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:56 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-da88e8db-8dac-47c2-afa9-238beb6f09b2 req-c96ee1ce-ed62-4006-b511-f0bf39c7a3d0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:56 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-da88e8db-8dac-47c2-afa9-238beb6f09b2 req-c96ee1ce-ed62-4006-b511-f0bf39c7a3d0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:56 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-da88e8db-8dac-47c2-afa9-238beb6f09b2 req-c96ee1ce-ed62-4006-b511-f0bf39c7a3d0 service nova] Creating event network-vif-deleted:7ad2ab36-6497-4d5a-97c3-ed8f199b307c for instance 2d620928-08c0-4c12-98f0-8689e12c282e on user Apr 18 13:00:56 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-da88e8db-8dac-47c2-afa9-238beb6f09b2 req-c96ee1ce-ed62-4006-b511-f0bf39c7a3d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030803 Apr 18 13:00:56 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 108/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:00:57 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-b77277b4-5294-4697-8826-84daedcb41db req-5079a109-a08a-4288-8619-285e238e450f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d620928-08c0-4c12-98f0-8689e12c282e", "name": "network-vif-plugged", "status": "completed", "tag": "7ad2ab36-6497-4d5a-97c3-ed8f199b307c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:00:57 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-b77277b4-5294-4697-8826-84daedcb41db req-5079a109-a08a-4288-8619-285e238e450f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:00:57 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-b77277b4-5294-4697-8826-84daedcb41db req-5079a109-a08a-4288-8619-285e238e450f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:00:57 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-b77277b4-5294-4697-8826-84daedcb41db req-5079a109-a08a-4288-8619-285e238e450f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:00:57 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-b77277b4-5294-4697-8826-84daedcb41db req-5079a109-a08a-4288-8619-285e238e450f service nova] Creating event network-vif-plugged:7ad2ab36-6497-4d5a-97c3-ed8f199b307c for instance 2d620928-08c0-4c12-98f0-8689e12c282e on user Apr 18 13:00:57 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-b77277b4-5294-4697-8826-84daedcb41db req-5079a109-a08a-4288-8619-285e238e450f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027860 Apr 18 13:00:57 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 105/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:15 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:01:15 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 HTTP/1.1 Apr 18 13:01:15 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:01:15 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:01:15 user devstack@n-api.service[61395]: Connection: close Apr 18 13:01:15 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:01:15 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:01:15 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:01:15 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:01:15 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:01:15 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:01:15 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:01:15 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:01:15 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:01:15 user devstack@n-api.service[61395]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:01:15 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:01:15 user devstack@n-api.service[61395]: method: > Apr 18 13:01:15 user devstack@n-api.service[61395]: exception: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:01:15 user devstack@n-api.service[61395]: action_args: {'id': 'bccb0d4d-97d7-499f-8def-63ac33c430e7'} Apr 18 13:01:15 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:01:15 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:01:15 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:01:15 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-60bc7587-c65a-4aeb-ac06-a7387cfebd78 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 404 len: 111 microversion: 2.1 time: 0.036169 Apr 18 13:01:15 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 109/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:15 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:01:15 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:15 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:15 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-74de6674-2210-4c29-b0a6-4c79f3ecde9c tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '.version_select at 0x7fcf0d85ecb0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:15 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-74de6674-2210-4c29-b0a6-4c79f3ecde9c tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290364724" status: 202 len: 0 microversion: 2.1 time: 0.034627 Apr 18 13:01:15 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 13:01:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290364724 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:01:16 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:16 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:16 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a90882df-d759-4186-9739-45787299e2b5 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cbc9fc0>, body: {"keypair": {"name": "tempest-keypair-791048184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqrVQsEOzc1eMyFv7obToalqnAK/Kg3pbrNZeYIqKVFN3C9+Syo2aUlM25UwLG2Mwmc3RKSereKs7YkUN872/56Z9V38Yy/YC+vFOrQrBrP0hJD36T4A+vKcXWpOM3FLw=="}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:16 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-a90882df-d759-4186-9739-45787299e2b5 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:01:16 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-a90882df-d759-4186-9739-45787299e2b5 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for user 3c9ec5bee5f54903a88a917d6cf955bb and project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:01:16 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-a90882df-d759-4186-9739-45787299e2b5 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054215 Apr 18 13:01:16 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 106/324] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 13:01:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:17 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-336429784", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b1161c0c-5352-4d95-a8fc-0d1bdb88b6ff"}], "security_groups": [{"name": "tempest-securitygroup--2057546901"}], "key_name": "tempest-keypair-791048184", "user_data": "}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:17 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] validate_networks() for [('b1161c0c-5352-4d95-a8fc-0d1bdb88b6ff', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for user 3c9ec5bee5f54903a88a917d6cf955bb and project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 13:01:18 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 13:01:18 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-232b1166-1bb1-46d5-9ef0-9cddfc428ebf tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.659850 Apr 18 13:01:18 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 110/325] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 13:01:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 13:01:18 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-bf946ca2-8377-4cc2-8e5f-d67a26e45afa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:18 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-bf946ca2-8377-4cc2-8e5f-d67a26e45afa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:18 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-bf946ca2-8377-4cc2-8e5f-d67a26e45afa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:18 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-bf946ca2-8377-4cc2-8e5f-d67a26e45afa tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 200 len: 1234 microversion: 2.1 time: 0.067276 Apr 18 13:01:18 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:18 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 1234 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:19 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-80651790-961d-43a7-be71-10112a978f94 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.154409 Apr 18 13:01:19 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 107/327] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 13:01:19 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1/os-interface => generated 282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 13:01:20 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-9484b8b1-3250-4f2c-98e4-e78fdb8fdb88 req-8a4f3a90-12b1-4393-8d33-bd6264e3ebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9484b8b1-3250-4f2c-98e4-e78fdb8fdb88 req-8a4f3a90-12b1-4393-8d33-bd6264e3ebd7 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9484b8b1-3250-4f2c-98e4-e78fdb8fdb88 req-8a4f3a90-12b1-4393-8d33-bd6264e3ebd7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-9484b8b1-3250-4f2c-98e4-e78fdb8fdb88 req-8a4f3a90-12b1-4393-8d33-bd6264e3ebd7 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:20 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-9484b8b1-3250-4f2c-98e4-e78fdb8fdb88 req-8a4f3a90-12b1-4393-8d33-bd6264e3ebd7 service nova] Creating event network-changed:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 13:01:20 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-9484b8b1-3250-4f2c-98e4-e78fdb8fdb88 req-8a4f3a90-12b1-4393-8d33-bd6264e3ebd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029077 Apr 18 13:01:20 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 111/328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:20 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-533fa4bb-ef3a-4fbc-b9cf-5e7b3c5ef4a5 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1/ips" status: 200 len: 104 microversion: 2.1 time: 0.035771 Apr 18 13:01:20 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 111/329] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:01:20 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1/ips => generated 104 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1200012804"}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:21 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:21 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-71394a7f-c47f-4a85-a2e7-8becbf17851b req-7e8734fd-18d1-492d-a969-1796cca0a94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-71394a7f-c47f-4a85-a2e7-8becbf17851b req-7e8734fd-18d1-492d-a969-1796cca0a94c service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-71394a7f-c47f-4a85-a2e7-8becbf17851b req-7e8734fd-18d1-492d-a969-1796cca0a94c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-71394a7f-c47f-4a85-a2e7-8becbf17851b req-7e8734fd-18d1-492d-a969-1796cca0a94c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:21 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-71394a7f-c47f-4a85-a2e7-8becbf17851b req-7e8734fd-18d1-492d-a969-1796cca0a94c service nova] Creating event network-changed:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:01:21 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-71394a7f-c47f-4a85-a2e7-8becbf17851b req-7e8734fd-18d1-492d-a969-1796cca0a94c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Apr 18 13:01:21 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 112/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:22 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:01:22 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-73df532a-13f6-435a-8a05-f8a2c37d3a01 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 204 len: 0 microversion: 2.1 time: 0.112830 Apr 18 13:01:22 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 112/331] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:01:22 2023] DELETE /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-b4340660-e5bd-4055-b6c5-610f11064201 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d/action" status: 202 len: 52 microversion: 2.87 time: 1.015573 Apr 18 13:01:22 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 108/332] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 13:01:21 2023] POST /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d/action => generated 52 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Apr 18 13:01:22 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50769941c80e49539e5a6b8b027c0463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd0e11306684aa891b435589dafe377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:22 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-bd28904c-b7e9-4581-a815-83f1acfaf84a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 200 len: 1660 microversion: 2.1 time: 0.602017 Apr 18 13:01:22 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 113/333] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:22 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 1660 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:01:23 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}, {"server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "name": "network-vif-plugged", "status": "completed", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:23 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] Creating event network-vif-unplugged:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 13:01:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] Creating event network-vif-plugged:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 13:01:23 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-47ae520d-5a90-465b-9b90-2008cd4a809d req-f88a2f4f-78ac-4755-99f0-c2e9ea2a259d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030052 Apr 18 13:01:23 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 113/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:23 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:25 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e88655-c926-4b02-bb0e-35fba9f129a1", "name": "network-vif-deleted", "tag": "8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21"}, {"server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "name": "network-vif-plugged", "status": "completed", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}, {"server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "name": "network-vif-plugged", "status": "completed", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:25 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Creating event network-vif-deleted:8bd2a6d5-1ff7-43f8-95d0-8dc6d0c2cb21 for instance 69e88655-c926-4b02-bb0e-35fba9f129a1 on user Apr 18 13:01:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Creating event network-vif-plugged:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:01:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] Creating event network-vif-plugged:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:01:25 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-5a810a92-4aaa-4522-ae76-d909867b3e0f req-a0184b62-12e9-42ab-a154-8c902f8e0c00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040461 Apr 18 13:01:25 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 109/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:27 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:27 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-5582401d-b23b-4ab3-a2bb-8be576215350 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d" status: 200 len: 1691 microversion: 2.87 time: 0.271104 Apr 18 13:01:27 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 114/336] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:01:27 2023] GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] HTTP exception thrown: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Request method failure captured: Apr 18 13:01:30 user devstack@n-api.service[61394]: request: DELETE /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd HTTP/1.1 Apr 18 13:01:30 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:01:30 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:01:30 user devstack@n-api.service[61394]: Connection: close Apr 18 13:01:30 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:01:30 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:01:30 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:01:30 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:01:30 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpKhgut7rFPA6_gSQJTVPdnWjqLLEowTwNLXudelhI-sYNMssNy343y6PMeV5h2Lnlo0V3zVAXU2T39cbXoooMf2iwx4c2MNExhrTINzHD5eblXiLG37HByo9orolGva623oiGqkQmxShxWJtZFNVkGf6TIs9WGwcmuLNl7NwKWtFfY Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Project-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Project-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Tenant: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Tenant-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-User: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 13:01:30 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:01:30 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:01:30 user devstack@n-api.service[61394]: X-User-Id: decaeb6e67f94c7a87fb782e089621f9 Apr 18 13:01:30 user devstack@n-api.service[61394]: X-User-Name: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 13:01:30 user devstack@n-api.service[61394]: method: > Apr 18 13:01:30 user devstack@n-api.service[61394]: exception: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61394]: action_args: {'id': 'd01aeff8-a91d-477a-a530-4147ce9670fd'} Apr 18 13:01:30 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Returning 404 to user: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:01:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-9d6325d5-ce47-4f2f-9783-66f2bbf775b5 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 404 len: 111 microversion: 2.1 time: 0.034424 Apr 18 13:01:30 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 114/337] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:01:30 2023] DELETE /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: d01aeff8-a91d-477a-a530-4147ce9670fd] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] HTTP exception thrown: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Request method failure captured: Apr 18 13:01:30 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd HTTP/1.1 Apr 18 13:01:30 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:01:30 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:01:30 user devstack@n-api.service[61393]: Connection: close Apr 18 13:01:30 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:01:30 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:01:30 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:01:30 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:01:30 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpKhgut7rFPA6_gSQJTVPdnWjqLLEowTwNLXudelhI-sYNMssNy343y6PMeV5h2Lnlo0V3zVAXU2T39cbXoooMf2iwx4c2MNExhrTINzHD5eblXiLG37HByo9orolGva623oiGqkQmxShxWJtZFNVkGf6TIs9WGwcmuLNl7NwKWtFfY Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Project-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Project-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Tenant: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Tenant-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-User: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 13:01:30 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:01:30 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:01:30 user devstack@n-api.service[61393]: X-User-Id: decaeb6e67f94c7a87fb782e089621f9 Apr 18 13:01:30 user devstack@n-api.service[61393]: X-User-Name: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 13:01:30 user devstack@n-api.service[61393]: method: > Apr 18 13:01:30 user devstack@n-api.service[61393]: exception: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61393]: action_args: {'id': 'd01aeff8-a91d-477a-a530-4147ce9670fd'} Apr 18 13:01:30 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. Apr 18 13:01:30 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Returning 404 to user: Instance d01aeff8-a91d-477a-a530-4147ce9670fd could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:01:30 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ac74bebf-bd72-4386-af10-46628f185567 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd" status: 404 len: 111 microversion: 2.1 time: 0.033611 Apr 18 13:01:30 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 110/338] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:30 2023] GET /compute/v2.1/servers/d01aeff8-a91d-477a-a530-4147ce9670fd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Going to try to terminate instance {{(pid=61395) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:01:30 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-d884bdba-a64b-465d-959c-bcbbd3f55a53 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 204 len: 0 microversion: 2.1 time: 0.123383 Apr 18 13:01:30 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 115/339] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:01:30 2023] DELETE /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-906e68e4-f136-445e-a8b4-c383770946f4 req-a2523182-3896-40d5-b18b-5a92893c9cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898", "name": "network-vif-unplugged", "status": "completed", "tag": "026f2768-4256-4d5c-a1f9-15c5069d9f5c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-906e68e4-f136-445e-a8b4-c383770946f4 req-a2523182-3896-40d5-b18b-5a92893c9cd6 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-906e68e4-f136-445e-a8b4-c383770946f4 req-a2523182-3896-40d5-b18b-5a92893c9cd6 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:30 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-906e68e4-f136-445e-a8b4-c383770946f4 req-a2523182-3896-40d5-b18b-5a92893c9cd6 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:30 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decaeb6e67f94c7a87fb782e089621f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76859b643e84f8f83b6092498f0f2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:30 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-906e68e4-f136-445e-a8b4-c383770946f4 req-a2523182-3896-40d5-b18b-5a92893c9cd6 service nova] Creating event network-vif-unplugged:026f2768-4256-4d5c-a1f9-15c5069d9f5c for instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 on user Apr 18 13:01:30 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-22e0f0e5-f964-4146-84fa-674c1aebb52b tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 200 len: 1499 microversion: 2.1 time: 0.291928 Apr 18 13:01:30 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:30 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:01:30 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-906e68e4-f136-445e-a8b4-c383770946f4 req-a2523182-3896-40d5-b18b-5a92893c9cd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032214 Apr 18 13:01:30 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 111/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:31 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-6cca2700-71aa-4ea9-ada0-3560d602dfd5 req-9c7e239a-2046-42e0-879f-0754bc36ffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898", "name": "network-vif-deleted", "tag": "026f2768-4256-4d5c-a1f9-15c5069d9f5c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-6cca2700-71aa-4ea9-ada0-3560d602dfd5 req-9c7e239a-2046-42e0-879f-0754bc36ffd5 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-6cca2700-71aa-4ea9-ada0-3560d602dfd5 req-9c7e239a-2046-42e0-879f-0754bc36ffd5 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:31 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-6cca2700-71aa-4ea9-ada0-3560d602dfd5 req-9c7e239a-2046-42e0-879f-0754bc36ffd5 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:31 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-6cca2700-71aa-4ea9-ada0-3560d602dfd5 req-9c7e239a-2046-42e0-879f-0754bc36ffd5 service nova] Creating event network-vif-deleted:026f2768-4256-4d5c-a1f9-15c5069d9f5c for instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 on user Apr 18 13:01:31 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-6cca2700-71aa-4ea9-ada0-3560d602dfd5 req-9c7e239a-2046-42e0-879f-0754bc36ffd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028936 Apr 18 13:01:31 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 116/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:32 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-0b82df06-18c6-4996-9d29-672bfe34a38c req-7b9f2f77-9a13-40ac-a8c4-39499b619a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898", "name": "network-vif-plugged", "status": "completed", "tag": "026f2768-4256-4d5c-a1f9-15c5069d9f5c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0b82df06-18c6-4996-9d29-672bfe34a38c req-7b9f2f77-9a13-40ac-a8c4-39499b619a4f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0b82df06-18c6-4996-9d29-672bfe34a38c req-7b9f2f77-9a13-40ac-a8c4-39499b619a4f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:32 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0b82df06-18c6-4996-9d29-672bfe34a38c req-7b9f2f77-9a13-40ac-a8c4-39499b619a4f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:32 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-0b82df06-18c6-4996-9d29-672bfe34a38c req-7b9f2f77-9a13-40ac-a8c4-39499b619a4f service nova] Creating event network-vif-plugged:026f2768-4256-4d5c-a1f9-15c5069d9f5c for instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 on user Apr 18 13:01:32 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-0b82df06-18c6-4996-9d29-672bfe34a38c req-7b9f2f77-9a13-40ac-a8c4-39499b619a4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028763 Apr 18 13:01:32 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 116/343] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:38 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:39 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:01:39 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-4aa82974-b785-4a8e-8d12-0e590fa66875 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 204 len: 0 microversion: 2.1 time: 0.114764 Apr 18 13:01:39 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 112/344] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:01:38 2023] DELETE /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:39 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-0c91f6b1-e838-48f2-b188-d6a9b1e37986 req-45c65eb8-be2b-4ad7-ac8c-eff31a3a9ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "name": "network-vif-unplugged", "status": "completed", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0c91f6b1-e838-48f2-b188-d6a9b1e37986 req-45c65eb8-be2b-4ad7-ac8c-eff31a3a9ee1 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0c91f6b1-e838-48f2-b188-d6a9b1e37986 req-45c65eb8-be2b-4ad7-ac8c-eff31a3a9ee1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:39 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0c91f6b1-e838-48f2-b188-d6a9b1e37986 req-45c65eb8-be2b-4ad7-ac8c-eff31a3a9ee1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-0c91f6b1-e838-48f2-b188-d6a9b1e37986 req-45c65eb8-be2b-4ad7-ac8c-eff31a3a9ee1 service nova] Creating event network-vif-unplugged:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 13:01:39 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-0c91f6b1-e838-48f2-b188-d6a9b1e37986 req-45c65eb8-be2b-4ad7-ac8c-eff31a3a9ee1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029884 Apr 18 13:01:39 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 117/345] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:39 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448cad17bf74486ca000696c14625592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542eb5fc47614fcb9d244b0ea58fc979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:39 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e51d8485-4df9-4af1-8407-90b2616f4554 tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 200 len: 1663 microversion: 2.1 time: 0.273568 Apr 18 13:01:39 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 117/346] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:39 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 1663 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: dddb0813-98a2-4754-baca-9bfff5ed3333] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:40 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] HTTP exception thrown: Instance dddb0813-98a2-4754-baca-9bfff5ed3333 could not be found. Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Request method failure captured: Apr 18 13:01:40 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 HTTP/1.1 Apr 18 13:01:40 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:01:40 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:01:40 user devstack@n-api.service[61393]: Connection: close Apr 18 13:01:40 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:01:40 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:01:40 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:01:40 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:01:40 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpNjw9JTJjQA9bmc7Uy4rbnMo5WEKX3Rm7kfuJWb6AleuQbyy5DDkH_yGzVu29mztNN4Vp5_rURJDFfZvNLgmIOukoD5BsV3k-lmG_3LQEiIVxMSmLie53Eo1BMCPDNN3sAOS6YTlb2zoWDnkHlSJAS-3rhhqQf81p3_wTB5TRbWVQc Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Project-Id: 3891288074444cadbdc9642ffae69e5d Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151331987 Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3891288074444cadbdc9642ffae69e5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3891288074444cadbdc9642ffae69e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3891288074444cadbdc9642ffae69e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151331987 Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Tenant-Id: 3891288074444cadbdc9642ffae69e5d Apr 18 13:01:40 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151331987 Apr 18 13:01:40 user devstack@n-api.service[61393]: X-User: tempest-ServerRescueNegativeTestJSON-151331987-project-member Apr 18 13:01:40 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:01:40 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:01:40 user devstack@n-api.service[61393]: X-User-Id: cb05642f149e41149aab9393241bbddc Apr 18 13:01:40 user devstack@n-api.service[61393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151331987-project-member Apr 18 13:01:40 user devstack@n-api.service[61393]: method: > Apr 18 13:01:40 user devstack@n-api.service[61393]: exception: Instance dddb0813-98a2-4754-baca-9bfff5ed3333 could not be found. Apr 18 13:01:40 user devstack@n-api.service[61393]: action_args: {'id': 'dddb0813-98a2-4754-baca-9bfff5ed3333'} Apr 18 13:01:40 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dddb0813-98a2-4754-baca-9bfff5ed3333 could not be found. Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dddb0813-98a2-4754-baca-9bfff5ed3333 could not be found. Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dddb0813-98a2-4754-baca-9bfff5ed3333 could not be found. Apr 18 13:01:40 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:40 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Returning 404 to user: Instance dddb0813-98a2-4754-baca-9bfff5ed3333 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:01:40 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-db8610ce-b8fc-4ac2-85f6-452463144d26 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333" status: 404 len: 111 microversion: 2.1 time: 0.128392 Apr 18 13:01:40 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 113/347] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:40 2023] GET /compute/v2.1/servers/dddb0813-98a2-4754-baca-9bfff5ed3333 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:40 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:01:40 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-8c771072-9aea-4608-b6fc-0f6379750a16 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06" status: 204 len: 0 microversion: 2.1 time: 0.110824 Apr 18 13:01:40 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 118/348] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:01:40 2023] DELETE /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:40 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-1c867f4e-5c9c-4022-86bc-3d62846ba34b req-219d1361-bf1b-4174-aa86-3e1f8812c87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d928be03-793a-4b7c-810e-e4af90206e06", "name": "network-vif-unplugged", "status": "completed", "tag": "913f05d6-4a84-44f2-b13f-f49b2b132fc4"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-1c867f4e-5c9c-4022-86bc-3d62846ba34b req-219d1361-bf1b-4174-aa86-3e1f8812c87f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-1c867f4e-5c9c-4022-86bc-3d62846ba34b req-219d1361-bf1b-4174-aa86-3e1f8812c87f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-1c867f4e-5c9c-4022-86bc-3d62846ba34b req-219d1361-bf1b-4174-aa86-3e1f8812c87f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-1c867f4e-5c9c-4022-86bc-3d62846ba34b req-219d1361-bf1b-4174-aa86-3e1f8812c87f service nova] Creating event network-vif-unplugged:913f05d6-4a84-44f2-b13f-f49b2b132fc4 for instance d928be03-793a-4b7c-810e-e4af90206e06 on user Apr 18 13:01:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-1c867f4e-5c9c-4022-86bc-3d62846ba34b req-219d1361-bf1b-4174-aa86-3e1f8812c87f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032233 Apr 18 13:01:41 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 114/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:41 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb05642f149e41149aab9393241bbddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3891288074444cadbdc9642ffae69e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:01:41 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-4b472d7a-a8e9-414e-ac0a-50e0647ab4e6 tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06" status: 200 len: 1508 microversion: 2.1 time: 0.386149 Apr 18 13:01:41 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:40 2023] GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:01:41 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-3959e073-7e58-43bb-be9b-f9817884677b req-734b56d9-1c57-4bf9-b26c-7833fd094901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "name": "network-vif-deleted", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:41 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-3959e073-7e58-43bb-be9b-f9817884677b req-734b56d9-1c57-4bf9-b26c-7833fd094901 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:41 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-3959e073-7e58-43bb-be9b-f9817884677b req-734b56d9-1c57-4bf9-b26c-7833fd094901 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:41 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-3959e073-7e58-43bb-be9b-f9817884677b req-734b56d9-1c57-4bf9-b26c-7833fd094901 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:41 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-3959e073-7e58-43bb-be9b-f9817884677b req-734b56d9-1c57-4bf9-b26c-7833fd094901 service nova] Creating event network-vif-deleted:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 13:01:41 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-3959e073-7e58-43bb-be9b-f9817884677b req-734b56d9-1c57-4bf9-b26c-7833fd094901 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Apr 18 13:01:41 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 119/351] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-5aa8975b-3d61-4de3-bfaa-e57d5da0c465 req-8e3352f9-7c6f-411b-baeb-0c2d225979e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4438eec9-265f-4187-8295-775d108c8c77", "name": "network-vif-plugged", "status": "completed", "tag": "28e7e539-360b-4fb1-b5aa-ccaeb039585e"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5aa8975b-3d61-4de3-bfaa-e57d5da0c465 req-8e3352f9-7c6f-411b-baeb-0c2d225979e8 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5aa8975b-3d61-4de3-bfaa-e57d5da0c465 req-8e3352f9-7c6f-411b-baeb-0c2d225979e8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:41 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5aa8975b-3d61-4de3-bfaa-e57d5da0c465 req-8e3352f9-7c6f-411b-baeb-0c2d225979e8 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-5aa8975b-3d61-4de3-bfaa-e57d5da0c465 req-8e3352f9-7c6f-411b-baeb-0c2d225979e8 service nova] Creating event network-vif-plugged:28e7e539-360b-4fb1-b5aa-ccaeb039585e for instance 4438eec9-265f-4187-8295-775d108c8c77 on user Apr 18 13:01:41 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-5aa8975b-3d61-4de3-bfaa-e57d5da0c465 req-8e3352f9-7c6f-411b-baeb-0c2d225979e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 Apr 18 13:01:41 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 115/352] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:43 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-2639430b-ae54-446a-ae9f-7aa0c7c0a678 req-4a5d9b17-6dd8-466f-83ea-11d39461f9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d928be03-793a-4b7c-810e-e4af90206e06", "name": "network-vif-plugged", "status": "completed", "tag": "913f05d6-4a84-44f2-b13f-f49b2b132fc4"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:43 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-2639430b-ae54-446a-ae9f-7aa0c7c0a678 req-4a5d9b17-6dd8-466f-83ea-11d39461f9fe service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:43 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-2639430b-ae54-446a-ae9f-7aa0c7c0a678 req-4a5d9b17-6dd8-466f-83ea-11d39461f9fe service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:43 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-2639430b-ae54-446a-ae9f-7aa0c7c0a678 req-4a5d9b17-6dd8-466f-83ea-11d39461f9fe service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:43 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-2639430b-ae54-446a-ae9f-7aa0c7c0a678 req-4a5d9b17-6dd8-466f-83ea-11d39461f9fe service nova] Creating event network-vif-plugged:913f05d6-4a84-44f2-b13f-f49b2b132fc4 for instance d928be03-793a-4b7c-810e-e4af90206e06 on user Apr 18 13:01:43 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-2639430b-ae54-446a-ae9f-7aa0c7c0a678 req-4a5d9b17-6dd8-466f-83ea-11d39461f9fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028257 Apr 18 13:01:43 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 119/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:43 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-a1c183b5-b158-4cb9-b37a-648bcc2fbbc3 req-d50435d7-04d1-4da5-b4c4-d5d53d0938e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d928be03-793a-4b7c-810e-e4af90206e06", "name": "network-vif-deleted", "tag": "913f05d6-4a84-44f2-b13f-f49b2b132fc4"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:01:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a1c183b5-b158-4cb9-b37a-648bcc2fbbc3 req-d50435d7-04d1-4da5-b4c4-d5d53d0938e0 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a1c183b5-b158-4cb9-b37a-648bcc2fbbc3 req-d50435d7-04d1-4da5-b4c4-d5d53d0938e0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:43 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a1c183b5-b158-4cb9-b37a-648bcc2fbbc3 req-d50435d7-04d1-4da5-b4c4-d5d53d0938e0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:43 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-a1c183b5-b158-4cb9-b37a-648bcc2fbbc3 req-d50435d7-04d1-4da5-b4c4-d5d53d0938e0 service nova] Creating event network-vif-deleted:913f05d6-4a84-44f2-b13f-f49b2b132fc4 for instance d928be03-793a-4b7c-810e-e4af90206e06 on user Apr 18 13:01:43 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-a1c183b5-b158-4cb9-b37a-648bcc2fbbc3 req-d50435d7-04d1-4da5-b4c4-d5d53d0938e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028142 Apr 18 13:01:43 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 120/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] [instance: 2d620928-08c0-4c12-98f0-8689e12c282e] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:01:45 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] HTTP exception thrown: Instance 2d620928-08c0-4c12-98f0-8689e12c282e could not be found. Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Request method failure captured: Apr 18 13:01:45 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e HTTP/1.1 Apr 18 13:01:45 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:01:45 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:01:45 user devstack@n-api.service[61393]: Connection: close Apr 18 13:01:45 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:01:45 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:01:45 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:01:45 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:01:45 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpQU3Pg0iGU4RxCwR7zfC2IlPIqUQ2sNTjiqdXF9VvEPqsSz6XMgVPFvlS7nvrfwRmULfN41oLrxwKn4AZqDsRNkN-Aknh_OTW4gwHhdqtycFjaBKC_qoJ_RvL77erE5_whTbfSKTE5MjldPC22o3rSROar4k05DchjW4uJ71pzrVyw Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Project-Id: 9bb6a99f412a417fb58937d0f7baa860 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Project-Name: tempest-VolumesActionsTest-1398952049 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6a99f412a417fb58937d0f7baa860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6a99f412a417fb58937d0f7baa860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6a99f412a417fb58937d0f7baa860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Tenant: tempest-VolumesActionsTest-1398952049 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Tenant-Id: 9bb6a99f412a417fb58937d0f7baa860 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-VolumesActionsTest-1398952049 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-User: tempest-VolumesActionsTest-1398952049-project-member Apr 18 13:01:45 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:01:45 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:01:45 user devstack@n-api.service[61393]: X-User-Id: ce977d6c71f34baeae41ae7346e972f4 Apr 18 13:01:45 user devstack@n-api.service[61393]: X-User-Name: tempest-VolumesActionsTest-1398952049-project-member Apr 18 13:01:45 user devstack@n-api.service[61393]: method: > Apr 18 13:01:45 user devstack@n-api.service[61393]: exception: Instance 2d620928-08c0-4c12-98f0-8689e12c282e could not be found. Apr 18 13:01:45 user devstack@n-api.service[61393]: action_args: {'id': '2d620928-08c0-4c12-98f0-8689e12c282e'} Apr 18 13:01:45 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d620928-08c0-4c12-98f0-8689e12c282e could not be found. Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d620928-08c0-4c12-98f0-8689e12c282e could not be found. Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d620928-08c0-4c12-98f0-8689e12c282e could not be found. Apr 18 13:01:45 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:01:45 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] Returning 404 to user: Instance 2d620928-08c0-4c12-98f0-8689e12c282e could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:01:45 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-71217b12-4e90-4ad2-a5c0-7cf06b0e0d52 tempest-VolumesActionsTest-1398952049 tempest-VolumesActionsTest-1398952049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e" status: 404 len: 111 microversion: 2.1 time: 0.027394 Apr 18 13:01:45 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 116/355] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:01:45 2023] GET /compute/v2.1/servers/2d620928-08c0-4c12-98f0-8689e12c282e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:08 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:02:08 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-3b45fcb8-15fd-4dce-a1de-2edd5117ff7e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 200 len: 1544 microversion: 2.1 time: 0.394850 Apr 18 13:02:08 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 120/356] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:08 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 1544 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:12 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] HTTP exception thrown: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Request method failure captured: Apr 18 13:02:12 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 HTTP/1.1 Apr 18 13:02:12 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:02:12 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:02:12 user devstack@n-api.service[61394]: Connection: close Apr 18 13:02:12 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:02:12 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:02:12 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:02:12 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:02:12 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpQtiVI8FiR8ehHtCDHItj0RBeYAguUAwMUa4aOKKfTpU4UAImmnZXusHYVVfJvXyatxbCWvNbTdj8n7wxInvfDMd4hkev_KJ8LIgYSwHngMT1wBmsx-zR34sDv4i4iPvfB1JUVOA-QFyAZlk4ckm60dx1pxJd9H8ay0rUTuOmWomTs Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Project-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9fd0e11306684aa891b435589dafe377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Tenant-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:02:12 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:02:12 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:02:12 user devstack@n-api.service[61394]: X-User-Id: 50769941c80e49539e5a6b8b027c0463 Apr 18 13:02:12 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:02:12 user devstack@n-api.service[61394]: method: > Apr 18 13:02:12 user devstack@n-api.service[61394]: exception: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:02:12 user devstack@n-api.service[61394]: action_args: {'id': '69e88655-c926-4b02-bb0e-35fba9f129a1'} Apr 18 13:02:12 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:02:12 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:12 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Returning 404 to user: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:02:12 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-90b1e8a2-9819-42eb-9166-202f39a27a46 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 404 len: 111 microversion: 2.1 time: 0.037851 Apr 18 13:02:12 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 121/357] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:12 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:02:12 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-697e9bd6-00c0-4cf5-8747-1120d0e52d6a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '.version_select at 0x7fcf0cbcb1c0>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:12 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:12 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:13 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-697e9bd6-00c0-4cf5-8747-1120d0e52d6a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118060509" status: 202 len: 0 microversion: 2.1 time: 0.190417 Apr 18 13:02:13 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 117/358] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 13:02:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118060509 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:02:13 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-28376be6-659d-42e8-8d78-06a3a3e1932b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Action: 'create', calling method: .version_select at 0x7fcf0ce4beb0>, body: {"keypair": {"name": "tempest-keypair-332974696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFunbVoUpxEEz1Fmx8VhLDo89sX1pHg8IhYUnKvzjhSogJOz+/0JZESR+e7fnGwW/onR3A6ehH8d13+UCktpUhGZq9zd4NFg/GacNGRFX/Irzvd3FCw1PTKJH//yqNKLA=="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:13 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-28376be6-659d-42e8-8d78-06a3a3e1932b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for project 9fd0e11306684aa891b435589dafe377. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:02:13 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-28376be6-659d-42e8-8d78-06a3a3e1932b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for user 50769941c80e49539e5a6b8b027c0463 and project 9fd0e11306684aa891b435589dafe377. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:02:13 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-28376be6-659d-42e8-8d78-06a3a3e1932b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063590 Apr 18 13:02:13 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 121/359] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 13:02:13 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:14 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-3501fd65-edec-42ce-b26d-5d257b17fbb7 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cd631c0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-750370206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrLVJJEtz80+REPmuO5g4TRyUdsxXYocn6MVkQB6Y3UM36+HEHMBctRxZYK4mwBBkk47mAT1Ukp22+WTWM4xOFSUuOVoXxxo0tcdppuXFQTCKMhvgvOB0HWeYY5Xgde+w=="}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:14 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-3501fd65-edec-42ce-b26d-5d257b17fbb7 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Getting quotas for project 9a7505bc42ae4268916430a419df38cd. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:02:14 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-3501fd65-edec-42ce-b26d-5d257b17fbb7 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Getting quotas for user 0ebce7f1474348bb92265e98d418f72e and project 9a7505bc42ae4268916430a419df38cd. Resources: {'key_pairs'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:02:14 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-3501fd65-edec-42ce-b26d-5d257b17fbb7 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.283519 Apr 18 13:02:14 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 122/360] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 13:02:13 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1677285710", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-750370206", "security_groups": [{"name": "tempest-secgroup-smoke-2022007863"}], "networks": [{"uuid": "0f61ebd1-64f6-4a31-b734-d04eeb53da79"}]}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.network.neutron [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] validate_networks() for [('0f61ebd1-64f6-4a31-b734-d04eeb53da79', None, None, None, None, None)] {{(pid=61393) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Flavor limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Image limits 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Flavor pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Image pref 0:0:0 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.virt.hardware [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Getting quotas for project 9a7505bc42ae4268916430a419df38cd. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Getting quotas for user 0ebce7f1474348bb92265e98d418f72e and project 9a7505bc42ae4268916430a419df38cd. Resources: {'cores', 'ram', 'instances'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Going to run 1 instances... {{(pid=61393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 13:02:15 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1450463283", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f41e5c26-b25d-4d76-af4d-048f7fe24c00"}], "security_groups": [{"name": "tempest-securitygroup--129750097"}], "key_name": "tempest-keypair-332974696", "user_data": "}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:16 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5dee321c-4e85-4ac4-8213-a610cdf8d52b tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.632644 Apr 18 13:02:16 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 118/361] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 13:02:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 13:02:16 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-00d20122-9df8-4f90-8861-28bd0410affb tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:16 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-00d20122-9df8-4f90-8861-28bd0410affb tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:16 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-00d20122-9df8-4f90-8861-28bd0410affb tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebce7f1474348bb92265e98d418f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7505bc42ae4268916430a419df38cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:02:16 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-00d20122-9df8-4f90-8861-28bd0410affb tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c" status: 200 len: 1256 microversion: 2.1 time: 0.070632 Apr 18 13:02:16 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 123/362] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:16 2023] GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] validate_networks() for [('f41e5c26-b25d-4d76-af4d-048f7fe24c00', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for project 9fd0e11306684aa891b435589dafe377. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Getting quotas for user 50769941c80e49539e5a6b8b027c0463 and project 9fd0e11306684aa891b435589dafe377. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 13:02:16 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 13:02:16 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-5ef609a9-3fe4-4e71-ab41-a01142e6038d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.654070 Apr 18 13:02:16 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 122/363] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 13:02:16 2023] POST /compute/v2.1/servers => generated 399 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 13:02:16 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-90c3398c-4322-4458-a953-fe700a605d97 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:16 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-90c3398c-4322-4458-a953-fe700a605d97 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:16 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-90c3398c-4322-4458-a953-fe700a605d97 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50769941c80e49539e5a6b8b027c0463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd0e11306684aa891b435589dafe377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:02:16 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-90c3398c-4322-4458-a953-fe700a605d97 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 200 len: 1231 microversion: 2.1 time: 0.060401 Apr 18 13:02:16 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 119/364] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:16 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 1231 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:02:18 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-a4ce24dc-9250-4a06-987b-37c6e8ec850c req-b544b549-628f-4361-85e7-fe86517b69b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "004b8940-ac51-48da-b4db-91a26934985c", "tag": "56d6f513-caa2-4875-822d-fe2fd731b2ea"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a4ce24dc-9250-4a06-987b-37c6e8ec850c req-b544b549-628f-4361-85e7-fe86517b69b2 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a4ce24dc-9250-4a06-987b-37c6e8ec850c req-b544b549-628f-4361-85e7-fe86517b69b2 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:18 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a4ce24dc-9250-4a06-987b-37c6e8ec850c req-b544b549-628f-4361-85e7-fe86517b69b2 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:18 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-a4ce24dc-9250-4a06-987b-37c6e8ec850c req-b544b549-628f-4361-85e7-fe86517b69b2 service nova] Creating event network-changed:56d6f513-caa2-4875-822d-fe2fd731b2ea for instance 004b8940-ac51-48da-b4db-91a26934985c on user Apr 18 13:02:18 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-a4ce24dc-9250-4a06-987b-37c6e8ec850c req-b544b549-628f-4361-85e7-fe86517b69b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028556 Apr 18 13:02:18 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 124/365] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:19 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-e51a5428-689c-4897-a6b6-4896f1074fc8 req-5cbba0eb-80e2-4748-8314-360ea6363e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e51a5428-689c-4897-a6b6-4896f1074fc8 req-5cbba0eb-80e2-4748-8314-360ea6363e79 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e51a5428-689c-4897-a6b6-4896f1074fc8 req-5cbba0eb-80e2-4748-8314-360ea6363e79 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:19 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-e51a5428-689c-4897-a6b6-4896f1074fc8 req-5cbba0eb-80e2-4748-8314-360ea6363e79 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:19 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-e51a5428-689c-4897-a6b6-4896f1074fc8 req-5cbba0eb-80e2-4748-8314-360ea6363e79 service nova] Creating event network-changed:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:02:19 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-e51a5428-689c-4897-a6b6-4896f1074fc8 req-5cbba0eb-80e2-4748-8314-360ea6363e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Apr 18 13:02:19 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 123/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] [instance: 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:20 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] HTTP exception thrown: Instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 could not be found. Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Request method failure captured: Apr 18 13:02:20 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 HTTP/1.1 Apr 18 13:02:20 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:02:20 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:02:20 user devstack@n-api.service[61393]: Connection: close Apr 18 13:02:20 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:02:20 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:02:20 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:02:20 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:02:20 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpKhgut7rFPA6_gSQJTVPdnWjqLLEowTwNLXudelhI-sYNMssNy343y6PMeV5h2Lnlo0V3zVAXU2T39cbXoooMf2iwx4c2MNExhrTINzHD5eblXiLG37HByo9orolGva623oiGqkQmxShxWJtZFNVkGf6TIs9WGwcmuLNl7NwKWtFfY Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Project-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Project-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a76859b643e84f8f83b6092498f0f2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Tenant: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Tenant-Id: a76859b643e84f8f83b6092498f0f2c0 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1168573805 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-User: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 13:02:20 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:02:20 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:02:20 user devstack@n-api.service[61393]: X-User-Id: decaeb6e67f94c7a87fb782e089621f9 Apr 18 13:02:20 user devstack@n-api.service[61393]: X-User-Name: tempest-ServersNegativeTestJSON-1168573805-project-member Apr 18 13:02:20 user devstack@n-api.service[61393]: method: > Apr 18 13:02:20 user devstack@n-api.service[61393]: exception: Instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 could not be found. Apr 18 13:02:20 user devstack@n-api.service[61393]: action_args: {'id': '1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898'} Apr 18 13:02:20 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 could not be found. Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 could not be found. Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 could not be found. Apr 18 13:02:20 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:20 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] Returning 404 to user: Instance 1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:02:20 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-77bd4f1c-3afa-49dd-93eb-3348fb8c3ec3 tempest-ServersNegativeTestJSON-1168573805 tempest-ServersNegativeTestJSON-1168573805-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898" status: 404 len: 111 microversion: 2.1 time: 0.029704 Apr 18 13:02:20 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 120/367] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:20 2023] GET /compute/v2.1/servers/1b4656bf-feb7-4ac8-8db9-4f3f0d0c9898 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:02:21 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-8300702f-c06e-4054-84f3-3cd0e3d54876 req-7b975565-edbd-4bd5-8e78-e4ba62261ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004b8940-ac51-48da-b4db-91a26934985c", "name": "network-vif-plugged", "status": "completed", "tag": "56d6f513-caa2-4875-822d-fe2fd731b2ea"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8300702f-c06e-4054-84f3-3cd0e3d54876 req-7b975565-edbd-4bd5-8e78-e4ba62261ff4 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8300702f-c06e-4054-84f3-3cd0e3d54876 req-7b975565-edbd-4bd5-8e78-e4ba62261ff4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:21 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-8300702f-c06e-4054-84f3-3cd0e3d54876 req-7b975565-edbd-4bd5-8e78-e4ba62261ff4 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:21 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-8300702f-c06e-4054-84f3-3cd0e3d54876 req-7b975565-edbd-4bd5-8e78-e4ba62261ff4 service nova] Creating event network-vif-plugged:56d6f513-caa2-4875-822d-fe2fd731b2ea for instance 004b8940-ac51-48da-b4db-91a26934985c on user Apr 18 13:02:21 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-8300702f-c06e-4054-84f3-3cd0e3d54876 req-7b975565-edbd-4bd5-8e78-e4ba62261ff4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033721 Apr 18 13:02:21 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 125/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:22 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-7a0c9a07-98df-4afc-8170-a0d435b0ef45 req-e55d947e-6808-492e-ae78-03155944bd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "name": "network-vif-plugged", "status": "completed", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-7a0c9a07-98df-4afc-8170-a0d435b0ef45 req-e55d947e-6808-492e-ae78-03155944bd18 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-7a0c9a07-98df-4afc-8170-a0d435b0ef45 req-e55d947e-6808-492e-ae78-03155944bd18 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:22 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-7a0c9a07-98df-4afc-8170-a0d435b0ef45 req-e55d947e-6808-492e-ae78-03155944bd18 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:22 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-7a0c9a07-98df-4afc-8170-a0d435b0ef45 req-e55d947e-6808-492e-ae78-03155944bd18 service nova] Creating event network-vif-plugged:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:02:22 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-7a0c9a07-98df-4afc-8170-a0d435b0ef45 req-e55d947e-6808-492e-ae78-03155944bd18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Apr 18 13:02:22 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:23 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-5b03c11a-c8d6-46ef-aaea-0869380b9a6c req-c1648388-2dc7-482b-a118-bdf29a1d999f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004b8940-ac51-48da-b4db-91a26934985c", "name": "network-vif-plugged", "status": "completed", "tag": "56d6f513-caa2-4875-822d-fe2fd731b2ea"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5b03c11a-c8d6-46ef-aaea-0869380b9a6c req-c1648388-2dc7-482b-a118-bdf29a1d999f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5b03c11a-c8d6-46ef-aaea-0869380b9a6c req-c1648388-2dc7-482b-a118-bdf29a1d999f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:23 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-5b03c11a-c8d6-46ef-aaea-0869380b9a6c req-c1648388-2dc7-482b-a118-bdf29a1d999f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:23 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-5b03c11a-c8d6-46ef-aaea-0869380b9a6c req-c1648388-2dc7-482b-a118-bdf29a1d999f service nova] Creating event network-vif-plugged:56d6f513-caa2-4875-822d-fe2fd731b2ea for instance 004b8940-ac51-48da-b4db-91a26934985c on user Apr 18 13:02:23 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-5b03c11a-c8d6-46ef-aaea-0869380b9a6c req-c1648388-2dc7-482b-a118-bdf29a1d999f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048792 Apr 18 13:02:23 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 121/370] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:24 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-0553865b-d8f5-4188-9b7c-2d260c799b0b req-a0c08d49-0792-4b93-93c6-155bd460e0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "name": "network-vif-plugged", "status": "completed", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:24 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0553865b-d8f5-4188-9b7c-2d260c799b0b req-a0c08d49-0792-4b93-93c6-155bd460e0db service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:24 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0553865b-d8f5-4188-9b7c-2d260c799b0b req-a0c08d49-0792-4b93-93c6-155bd460e0db service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:24 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-0553865b-d8f5-4188-9b7c-2d260c799b0b req-a0c08d49-0792-4b93-93c6-155bd460e0db service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:24 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-0553865b-d8f5-4188-9b7c-2d260c799b0b req-a0c08d49-0792-4b93-93c6-155bd460e0db service nova] Creating event network-vif-plugged:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:02:24 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-0553865b-d8f5-4188-9b7c-2d260c799b0b req-a0c08d49-0792-4b93-93c6-155bd460e0db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Apr 18 13:02:24 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 126/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:27 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1626093741", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "68265051-53bd-4952-9322-7c15e93b6a43", "destination_type": "volume"}], "networks": [{"uuid": "51847ea3-3c22-40cf-a9fc-97a5fa333674"}]}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:27 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:27 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=10 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:28 user devstack@n-api.service[61395]: DEBUG nova.network.neutron [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] validate_networks() for [('51847ea3-3c22-40cf-a9fc-97a5fa333674', None, None, None, None, None)] {{(pid=61395) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image limits 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Flavor pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Image pref 0:0:0 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.virt.hardware [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Getting quotas for user c85d24916dfd4caba3c62d5a25d4b18f and project cf35078a110c4689bbb41c77df70d9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Going to run 1 instances... {{(pid=61395) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 13:02:29 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-64970b68-5b6f-464e-95b6-35911603b9f0 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.301684 Apr 18 13:02:29 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 125/372] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 13:02:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-68d5eaa1-3ed1-4c0b-8a99-143297a5ca32 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-68d5eaa1-3ed1-4c0b-8a99-143297a5ca32 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=8 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] [instance: 4438eec9-265f-4187-8295-775d108c8c77] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-68d5eaa1-3ed1-4c0b-8a99-143297a5ca32 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:02:29 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] HTTP exception thrown: Instance 4438eec9-265f-4187-8295-775d108c8c77 could not be found. Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-68d5eaa1-3ed1-4c0b-8a99-143297a5ca32 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:02:29 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-68d5eaa1-3ed1-4c0b-8a99-143297a5ca32 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Request method failure captured: Apr 18 13:02:29 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 HTTP/1.1 Apr 18 13:02:29 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:02:29 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:02:29 user devstack@n-api.service[61394]: Connection: close Apr 18 13:02:29 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:02:29 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:02:29 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:02:29 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:02:29 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpKT-SA53KdKETF871ykdTEK9n_Mkhqil_fpCBSifWrsLMaSBlapw8lIJScTgvEMXDcuquI4aI7ToV0EMRGObWiKA80VOd1W6ir4xHYC2smKGam4hoT393I5_8xJWdvUVUWZDX3TnUKYeAb1T_HcCfQu-NWGly7OKNOTR54pwB0ooOk Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Project-Id: 542eb5fc47614fcb9d244b0ea58fc979 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Project-Name: tempest-ServerActionsTestJSON-1422588562 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/542eb5fc47614fcb9d244b0ea58fc979"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/542eb5fc47614fcb9d244b0ea58fc979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/542eb5fc47614fcb9d244b0ea58fc979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Tenant: tempest-ServerActionsTestJSON-1422588562 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Tenant-Id: 542eb5fc47614fcb9d244b0ea58fc979 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-ServerActionsTestJSON-1422588562 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-User: tempest-ServerActionsTestJSON-1422588562-project-member Apr 18 13:02:29 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:02:29 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:02:29 user devstack@n-api.service[61394]: X-User-Id: 448cad17bf74486ca000696c14625592 Apr 18 13:02:29 user devstack@n-api.service[61394]: X-User-Name: tempest-ServerActionsTestJSON-1422588562-project-member Apr 18 13:02:29 user devstack@n-api.service[61394]: method: > Apr 18 13:02:29 user devstack@n-api.service[61394]: exception: Instance 4438eec9-265f-4187-8295-775d108c8c77 could not be found. Apr 18 13:02:29 user devstack@n-api.service[61394]: action_args: {'id': '4438eec9-265f-4187-8295-775d108c8c77'} Apr 18 13:02:29 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4438eec9-265f-4187-8295-775d108c8c77 could not be found. Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4438eec9-265f-4187-8295-775d108c8c77 could not be found. Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4438eec9-265f-4187-8295-775d108c8c77 could not be found. Apr 18 13:02:29 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:02:29 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-68d5eaa1-3ed1-4c0b-8a99-143297a5ca32 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31" status: 200 len: 1395 microversion: 2.87 time: 0.212563 Apr 18 13:02:29 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 122/373] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:02:29 2023] GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31 => generated 1395 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 13:02:29 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Returning 404 to user: Instance 4438eec9-265f-4187-8295-775d108c8c77 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:02:29 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-fc33eca4-bc85-48ea-a2c8-f4d7be22722b tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77" status: 404 len: 111 microversion: 2.1 time: 0.056169 Apr 18 13:02:29 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 127/374] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:29 2023] GET /compute/v2.1/servers/4438eec9-265f-4187-8295-775d108c8c77 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:02:29 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e85a2373-cf74-4ced-a965-829e1983c0dc tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] Calling method '.version_select at 0x7fcf0ce481f0>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:29 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e85a2373-cf74-4ced-a965-829e1983c0dc tempest-ServerActionsTestJSON-1422588562 tempest-ServerActionsTestJSON-1422588562-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20614186" status: 202 len: 0 microversion: 2.1 time: 0.029783 Apr 18 13:02:29 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 13:02:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20614186 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] [instance: d928be03-793a-4b7c-810e-e4af90206e06] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:31 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] HTTP exception thrown: Instance d928be03-793a-4b7c-810e-e4af90206e06 could not be found. Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Request method failure captured: Apr 18 13:02:31 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06 HTTP/1.1 Apr 18 13:02:31 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:02:31 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:02:31 user devstack@n-api.service[61393]: Connection: close Apr 18 13:02:31 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:02:31 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:02:31 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:02:31 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:02:31 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpNjw9JTJjQA9bmc7Uy4rbnMo5WEKX3Rm7kfuJWb6AleuQbyy5DDkH_yGzVu29mztNN4Vp5_rURJDFfZvNLgmIOukoD5BsV3k-lmG_3LQEiIVxMSmLie53Eo1BMCPDNN3sAOS6YTlb2zoWDnkHlSJAS-3rhhqQf81p3_wTB5TRbWVQc Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Project-Id: 3891288074444cadbdc9642ffae69e5d Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151331987 Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3891288074444cadbdc9642ffae69e5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3891288074444cadbdc9642ffae69e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3891288074444cadbdc9642ffae69e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151331987 Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Tenant-Id: 3891288074444cadbdc9642ffae69e5d Apr 18 13:02:31 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151331987 Apr 18 13:02:31 user devstack@n-api.service[61393]: X-User: tempest-ServerRescueNegativeTestJSON-151331987-project-member Apr 18 13:02:31 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:02:31 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:02:31 user devstack@n-api.service[61393]: X-User-Id: cb05642f149e41149aab9393241bbddc Apr 18 13:02:31 user devstack@n-api.service[61393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151331987-project-member Apr 18 13:02:31 user devstack@n-api.service[61393]: method: > Apr 18 13:02:31 user devstack@n-api.service[61393]: exception: Instance d928be03-793a-4b7c-810e-e4af90206e06 could not be found. Apr 18 13:02:31 user devstack@n-api.service[61393]: action_args: {'id': 'd928be03-793a-4b7c-810e-e4af90206e06'} Apr 18 13:02:31 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d928be03-793a-4b7c-810e-e4af90206e06 could not be found. Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d928be03-793a-4b7c-810e-e4af90206e06 could not be found. Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d928be03-793a-4b7c-810e-e4af90206e06 could not be found. Apr 18 13:02:31 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:02:31 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] Returning 404 to user: Instance d928be03-793a-4b7c-810e-e4af90206e06 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:02:31 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-884c2e45-376f-4245-a247-27f7a5a4382c tempest-ServerRescueNegativeTestJSON-151331987 tempest-ServerRescueNegativeTestJSON-151331987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06" status: 404 len: 111 microversion: 2.1 time: 0.028494 Apr 18 13:02:31 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 123/376] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:02:31 2023] GET /compute/v2.1/servers/d928be03-793a-4b7c-810e-e4af90206e06 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:02:33 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-f07eff27-e654-40e6-9786-f40b189a022c req-83a39d32-acff-4a3e-9d84-9c4cc7c6d5dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739ae6a6-b42f-4f78-a585-3353d6b0bc31", "tag": "217d98c4-8d3a-4bba-96f7-6636e42094ab"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-f07eff27-e654-40e6-9786-f40b189a022c req-83a39d32-acff-4a3e-9d84-9c4cc7c6d5dc service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-f07eff27-e654-40e6-9786-f40b189a022c req-83a39d32-acff-4a3e-9d84-9c4cc7c6d5dc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:33 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-f07eff27-e654-40e6-9786-f40b189a022c req-83a39d32-acff-4a3e-9d84-9c4cc7c6d5dc service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:33 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-f07eff27-e654-40e6-9786-f40b189a022c req-83a39d32-acff-4a3e-9d84-9c4cc7c6d5dc service nova] Creating event network-changed:217d98c4-8d3a-4bba-96f7-6636e42094ab for instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 on user Apr 18 13:02:33 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-f07eff27-e654-40e6-9786-f40b189a022c req-83a39d32-acff-4a3e-9d84-9c4cc7c6d5dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036165 Apr 18 13:02:33 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 128/377] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:02:37 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-0c4f0831-44d7-4ec5-a7f9-2826637a971f req-633663b2-b339-4b12-84b5-1b3e90f6279b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ae6a6-b42f-4f78-a585-3353d6b0bc31", "name": "network-vif-deleted", "tag": "217d98c4-8d3a-4bba-96f7-6636e42094ab"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:37 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-0c4f0831-44d7-4ec5-a7f9-2826637a971f req-633663b2-b339-4b12-84b5-1b3e90f6279b service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:02:37 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-0c4f0831-44d7-4ec5-a7f9-2826637a971f req-633663b2-b339-4b12-84b5-1b3e90f6279b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:02:37 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-0c4f0831-44d7-4ec5-a7f9-2826637a971f req-633663b2-b339-4b12-84b5-1b3e90f6279b service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:02:37 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.compute.server_external_events [req-0c4f0831-44d7-4ec5-a7f9-2826637a971f req-633663b2-b339-4b12-84b5-1b3e90f6279b service nova] Unable to find a host for instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31. Dropping event network-vif-deleted {{(pid=61395) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 13:02:37 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-0c4f0831-44d7-4ec5-a7f9-2826637a971f req-633663b2-b339-4b12-84b5-1b3e90f6279b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029075 Apr 18 13:02:37 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 127/378] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:02:37 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 13:02:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=8 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:02:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-80d60b2b-af82-4967-bc18-aa62a658a80c tempest-TestStampPattern-352133786 tempest-TestStampPattern-352133786-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cbcab90>, body: {"keypair": {"name": "tempest-TestStampPattern-1732215051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeuR4hbLAAGLOvJ1BRkKyR8ocvMAdVcQHV9sSdzxtF/ICE/4H8VF/xOTJz3cz+s6lxbNSuX86x/OkQHJuFQ2gLqnKq4CoEUDC7y9vrE3IxcNEJTxbuCNU16ATTHuP7q8w=="}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:02:58 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-80d60b2b-af82-4967-bc18-aa62a658a80c tempest-TestStampPattern-352133786 tempest-TestStampPattern-352133786-project-member] Getting quotas for project eefb6f00fc8d4b7188b5fefe698038d4. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:02:58 user devstack@n-api.service[61393]: DEBUG nova.quota [None req-80d60b2b-af82-4967-bc18-aa62a658a80c tempest-TestStampPattern-352133786 tempest-TestStampPattern-352133786-project-member] Getting quotas for user 7a2be963f2c744f9a53f97ca65ed4c46 and project eefb6f00fc8d4b7188b5fefe698038d4. Resources: {'key_pairs'} {{(pid=61393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:02:58 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-80d60b2b-af82-4967-bc18-aa62a658a80c tempest-TestStampPattern-352133786 tempest-TestStampPattern-352133786-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.301588 Apr 18 13:02:58 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 124/379] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 13:02:58 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:01 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-422dbecf-d6da-488c-9972-f1a8381ee66a tempest-TestStampPattern-352133786 tempest-TestStampPattern-352133786-project-member] Calling method '.version_select at 0x7fcf0cd60790>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=12 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:01 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-422dbecf-d6da-488c-9972-f1a8381ee66a tempest-TestStampPattern-352133786 tempest-TestStampPattern-352133786-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1732215051" status: 202 len: 0 microversion: 2.1 time: 0.026033 Apr 18 13:03:01 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 129/380] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:03:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1732215051 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=2 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=6 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=16 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:06 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebce7f1474348bb92265e98d418f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7505bc42ae4268916430a419df38cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:06 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-2aac9189-1f49-44a0-a29f-3fccfa4f892d tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c" status: 200 len: 1569 microversion: 2.1 time: 0.311009 Apr 18 13:03:06 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 128/381] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:03:06 2023] GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c => generated 1569 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:06 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:07 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50769941c80e49539e5a6b8b027c0463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd0e11306684aa891b435589dafe377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c9b46bcd-d80b-4a2d-b2bd-01146a1111b4 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 200 len: 1536 microversion: 2.1 time: 0.249336 Apr 18 13:03:07 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 125/382] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:03:06 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 1536 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:09 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-9fe33b57-58c5-4894-9f70-524e9db4b7fd tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.383646 Apr 18 13:03:09 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 130/383] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 13:03:08 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2/os-interface => generated 282 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:09 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-2ac977c5-6c7c-4292-b36f-a6715c1cc4ee req-ed2d59fa-dbb7-47f8-add5-59cea65b1f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-2ac977c5-6c7c-4292-b36f-a6715c1cc4ee req-ed2d59fa-dbb7-47f8-add5-59cea65b1f47 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-2ac977c5-6c7c-4292-b36f-a6715c1cc4ee req-ed2d59fa-dbb7-47f8-add5-59cea65b1f47 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-2ac977c5-6c7c-4292-b36f-a6715c1cc4ee req-ed2d59fa-dbb7-47f8-add5-59cea65b1f47 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:09 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-2ac977c5-6c7c-4292-b36f-a6715c1cc4ee req-ed2d59fa-dbb7-47f8-add5-59cea65b1f47 service nova] Creating event network-changed:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:03:09 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-2ac977c5-6c7c-4292-b36f-a6715c1cc4ee req-ed2d59fa-dbb7-47f8-add5-59cea65b1f47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032499 Apr 18 13:03:09 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 129/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:09 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:09 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-adacf17a-8758-49c0-b7f2-ded2c7f4b305 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2/ips" status: 200 len: 108 microversion: 2.1 time: 0.042949 Apr 18 13:03:09 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 126/385] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:03:09 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:11 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:03:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-d3813eb3-bfd2-4de2-889a-fcf1c84059af tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 204 len: 0 microversion: 2.1 time: 0.104209 Apr 18 13:03:11 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 131/386] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:03:11 2023] DELETE /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:11 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:11 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-01423711-0e3f-40b5-ad0a-ea43a9c972ed tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 200 len: 1668 microversion: 2.1 time: 0.345961 Apr 18 13:03:11 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 130/387] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:03:11 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 1668 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:03:11 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-4bb2c342-60e3-4fdd-9a12-ae84048ecc5c req-6ae9d175-6127-438b-8178-b60612d9ca76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4bb2c342-60e3-4fdd-9a12-ae84048ecc5c req-6ae9d175-6127-438b-8178-b60612d9ca76 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4bb2c342-60e3-4fdd-9a12-ae84048ecc5c req-6ae9d175-6127-438b-8178-b60612d9ca76 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-4bb2c342-60e3-4fdd-9a12-ae84048ecc5c req-6ae9d175-6127-438b-8178-b60612d9ca76 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:11 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-4bb2c342-60e3-4fdd-9a12-ae84048ecc5c req-6ae9d175-6127-438b-8178-b60612d9ca76 service nova] Creating event network-vif-unplugged:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:03:11 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-4bb2c342-60e3-4fdd-9a12-ae84048ecc5c req-6ae9d175-6127-438b-8178-b60612d9ca76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028232 Apr 18 13:03:11 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 127/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:13 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-61c422de-3528-46a9-9b4d-b7e42a979d93 req-de174b9c-f1d6-4b9e-b224-7681d280164c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "name": "network-vif-deleted", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-61c422de-3528-46a9-9b4d-b7e42a979d93 req-de174b9c-f1d6-4b9e-b224-7681d280164c service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-61c422de-3528-46a9-9b4d-b7e42a979d93 req-de174b9c-f1d6-4b9e-b224-7681d280164c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-61c422de-3528-46a9-9b4d-b7e42a979d93 req-de174b9c-f1d6-4b9e-b224-7681d280164c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-61c422de-3528-46a9-9b4d-b7e42a979d93 req-de174b9c-f1d6-4b9e-b224-7681d280164c service nova] Creating event network-vif-deleted:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:03:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-61c422de-3528-46a9-9b4d-b7e42a979d93 req-de174b9c-f1d6-4b9e-b224-7681d280164c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095257 Apr 18 13:03:13 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 132/389] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:14 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-c8a60e54-13b5-4606-8bd2-f8dfd1bcdecc req-84b4bd8c-a345-4242-a60e-b40146c93a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa7cb8a-7e9f-45e2-806c-92811755d9a2", "name": "network-vif-plugged", "status": "completed", "tag": "52f1fa64-98e7-4a6a-861f-1e268104de84"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c8a60e54-13b5-4606-8bd2-f8dfd1bcdecc req-84b4bd8c-a345-4242-a60e-b40146c93a92 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c8a60e54-13b5-4606-8bd2-f8dfd1bcdecc req-84b4bd8c-a345-4242-a60e-b40146c93a92 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:14 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-c8a60e54-13b5-4606-8bd2-f8dfd1bcdecc req-84b4bd8c-a345-4242-a60e-b40146c93a92 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:14 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-c8a60e54-13b5-4606-8bd2-f8dfd1bcdecc req-84b4bd8c-a345-4242-a60e-b40146c93a92 service nova] Creating event network-vif-plugged:52f1fa64-98e7-4a6a-861f-1e268104de84 for instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 on user Apr 18 13:03:14 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-c8a60e54-13b5-4606-8bd2-f8dfd1bcdecc req-84b4bd8c-a345-4242-a60e-b40146c93a92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138748 Apr 18 13:03:14 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG nova.objects.instance [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lazy-loading 'fault' on Instance uuid 739ae6a6-b42f-4f78-a585-3353d6b0bc31 {{(pid=61393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:19 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:19 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-8a2edc3d-9b36-4fb6-aacd-2982b73adc29 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31" status: 200 len: 1650 microversion: 2.87 time: 0.119850 Apr 18 13:03:19 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 128/391] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:03:19 2023] GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31 => generated 1650 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Doing local delete in cell 8e2e7804-6c25-4b7a-b3e8-114c55cd91bc(cell1) {{(pid=61394) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:19 user devstack@n-api.service[61394]: WARNING nova.compute.api [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] instance's host None is down, deleting from database Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] deallocate_for_instance() {{(pid=61394) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Instance cache missing network info. {{(pid=61394) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Updating instance_info_cache with network_info: [] {{(pid=61394) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 13:03:19 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61394) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 13:03:19 user devstack@n-api.service[61394]: WARNING nova.compute.api [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 13:03:20 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-1b5e28d8-a529-4b62-b8b9-e7a22359b0b8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31" status: 204 len: 0 microversion: 2.87 time: 0.531533 Apr 18 13:03:20 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 133/392] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 13:03:19 2023] DELETE /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 739ae6a6-b42f-4f78-a585-3353d6b0bc31] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:20 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] HTTP exception thrown: Instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 could not be found. Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Request method failure captured: Apr 18 13:03:20 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31 HTTP/1.1 Apr 18 13:03:20 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:03:20 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:03:20 user devstack@n-api.service[61395]: Connection: close Apr 18 13:03:20 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:03:20 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:03:20 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:03:20 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:03:20 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpNMJXD0HO-FgJ0YHuBBOw0Fkzec-KZtPL4V3azLWHYng0lT6miJyjmxwcD3UU2nDXkkSoXpiVastnq2zCMgI-I87tErg_OrFHpyLKm0X6ePQBY4ZKqYOkUEPIwTwfxgoUZq8SZRrXHLO5okLUTkPdbyZ16m_iLRM3MhR1rske4bXCk Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Project-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Tenant-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 13:03:20 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:03:20 user devstack@n-api.service[61395]: X-User: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 13:03:20 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:03:20 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:03:20 user devstack@n-api.service[61395]: X-User-Id: c85d24916dfd4caba3c62d5a25d4b18f Apr 18 13:03:20 user devstack@n-api.service[61395]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 13:03:20 user devstack@n-api.service[61395]: method: > Apr 18 13:03:20 user devstack@n-api.service[61395]: exception: Instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 could not be found. Apr 18 13:03:20 user devstack@n-api.service[61395]: action_args: {'id': '739ae6a6-b42f-4f78-a585-3353d6b0bc31'} Apr 18 13:03:20 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 could not be found. Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 could not be found. Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 could not be found. Apr 18 13:03:20 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:03:20 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Returning 404 to user: Instance 739ae6a6-b42f-4f78-a585-3353d6b0bc31 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:03:20 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-4be2b9f1-75e4-4a27-9a96-961f8e00024f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31" status: 404 len: 111 microversion: 2.87 time: 0.036862 Apr 18 13:03:20 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 132/393] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:03:20 2023] GET /compute/v2.1/servers/739ae6a6-b42f-4f78-a585-3353d6b0bc31 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:20 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:03:20 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c4c35743-2838-461e-9bce-569f16ffa041 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d" status: 204 len: 0 microversion: 2.87 time: 0.110882 Apr 18 13:03:20 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 129/394] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 13:03:20 2023] DELETE /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:20 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:21 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-f94ff931-af8f-4417-9029-0b8881ced64d req-ae132439-bc4b-4d67-a8ec-32ec5af65d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b73b48-5c5d-4c77-88e0-3c473f659d6d", "name": "network-vif-unplugged", "status": "completed", "tag": "9ef84274-d3ad-4c78-9e5f-c6b4ce02176c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-f94ff931-af8f-4417-9029-0b8881ced64d req-ae132439-bc4b-4d67-a8ec-32ec5af65d37 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-f94ff931-af8f-4417-9029-0b8881ced64d req-ae132439-bc4b-4d67-a8ec-32ec5af65d37 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:21 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-f94ff931-af8f-4417-9029-0b8881ced64d req-ae132439-bc4b-4d67-a8ec-32ec5af65d37 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:21 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:21 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-f94ff931-af8f-4417-9029-0b8881ced64d req-ae132439-bc4b-4d67-a8ec-32ec5af65d37 service nova] Creating event network-vif-unplugged:9ef84274-d3ad-4c78-9e5f-c6b4ce02176c for instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d on user Apr 18 13:03:21 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:21 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:03:21 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-f94ff931-af8f-4417-9029-0b8881ced64d req-ae132439-bc4b-4d67-a8ec-32ec5af65d37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116457 Apr 18 13:03:21 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 133/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:21 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-e9596fc0-e28c-4831-89dd-42ac2c36aa13 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d" status: 200 len: 1697 microversion: 2.87 time: 0.487621 Apr 18 13:03:21 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 134/396] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:03:20 2023] GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d => generated 1697 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 13:03:22 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-9a17dc6a-a167-40e0-aca6-e13b4ba79fda req-5a37130a-7f9c-4983-bbd7-94c0aef29f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b73b48-5c5d-4c77-88e0-3c473f659d6d", "name": "network-vif-deleted", "tag": "9ef84274-d3ad-4c78-9e5f-c6b4ce02176c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-9a17dc6a-a167-40e0-aca6-e13b4ba79fda req-5a37130a-7f9c-4983-bbd7-94c0aef29f53 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-9a17dc6a-a167-40e0-aca6-e13b4ba79fda req-5a37130a-7f9c-4983-bbd7-94c0aef29f53 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:22 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-9a17dc6a-a167-40e0-aca6-e13b4ba79fda req-5a37130a-7f9c-4983-bbd7-94c0aef29f53 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-9a17dc6a-a167-40e0-aca6-e13b4ba79fda req-5a37130a-7f9c-4983-bbd7-94c0aef29f53 service nova] Creating event network-vif-deleted:9ef84274-d3ad-4c78-9e5f-c6b4ce02176c for instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d on user Apr 18 13:03:22 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-9a17dc6a-a167-40e0-aca6-e13b4ba79fda req-5a37130a-7f9c-4983-bbd7-94c0aef29f53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028574 Apr 18 13:03:22 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 130/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:03:23 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-b5d17279-21b3-4452-a378-853bce82e826 req-1c51068a-faf2-4acc-ab6a-db9bda9eb86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b73b48-5c5d-4c77-88e0-3c473f659d6d", "name": "network-vif-plugged", "status": "completed", "tag": "9ef84274-d3ad-4c78-9e5f-c6b4ce02176c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:03:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-b5d17279-21b3-4452-a378-853bce82e826 req-1c51068a-faf2-4acc-ab6a-db9bda9eb86c service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:03:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-b5d17279-21b3-4452-a378-853bce82e826 req-1c51068a-faf2-4acc-ab6a-db9bda9eb86c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:03:23 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-b5d17279-21b3-4452-a378-853bce82e826 req-1c51068a-faf2-4acc-ab6a-db9bda9eb86c service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:03:23 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-b5d17279-21b3-4452-a378-853bce82e826 req-1c51068a-faf2-4acc-ab6a-db9bda9eb86c service nova] Creating event network-vif-plugged:9ef84274-d3ad-4c78-9e5f-c6b4ce02176c for instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d on user Apr 18 13:03:23 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-b5d17279-21b3-4452-a378-853bce82e826 req-1c51068a-faf2-4acc-ab6a-db9bda9eb86c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Apr 18 13:03:23 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 134/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:03:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:01 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:01 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:01 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:04:02 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 HTTP/1.1 Apr 18 13:04:02 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:04:02 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:04:02 user devstack@n-api.service[61394]: Connection: close Apr 18 13:04:02 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:04:02 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:04:02 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:04:02 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:04:02 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:04:02 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:04:02 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:04:02 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:04:02 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:04:02 user devstack@n-api.service[61394]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:04:02 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:04:02 user devstack@n-api.service[61394]: method: > Apr 18 13:04:02 user devstack@n-api.service[61394]: exception: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:04:02 user devstack@n-api.service[61394]: action_args: {'id': 'baa7cb8a-7e9f-45e2-806c-92811755d9a2'} Apr 18 13:04:02 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:04:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:04:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:04:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-431ddabb-bc13-41e2-99eb-8baa49a3c21f tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 404 len: 111 microversion: 2.1 time: 0.152763 Apr 18 13:04:02 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 135/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:01 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:04:02 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:02 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a396df35-49af-485f-a118-7023591d105e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '.version_select at 0x7fcf0cbc91b0>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:02 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-a396df35-49af-485f-a118-7023591d105e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791048184" status: 202 len: 0 microversion: 2.1 time: 0.030047 Apr 18 13:04:02 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 131/400] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 13:04:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791048184 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:04:02 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=14 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:02 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=22 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-a6b26534-f0fd-4486-ad93-5d86e48e0dc6 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Action: 'create', calling method: .version_select at 0x7fcf0d96fb50>, body: {"keypair": {"name": "tempest-keypair-1283719245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVqX+ZtrAcrjM6T1zVAY/FWaT0n/wL06PJyUkFbYOBFuHjSSClE6Q2oOS07q8LCxW8PuWIcc9vPZiNuU08y3xgq2PhR1G6+DGLmWSNP0KCJ5EZsKFF/pMoHJTlQUOh+Ug=="}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:02 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-a6b26534-f0fd-4486-ad93-5d86e48e0dc6 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:04:02 user devstack@n-api.service[61395]: DEBUG nova.quota [None req-a6b26534-f0fd-4486-ad93-5d86e48e0dc6 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for user 3c9ec5bee5f54903a88a917d6cf955bb and project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'key_pairs'} {{(pid=61395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:04:02 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-a6b26534-f0fd-4486-ad93-5d86e48e0dc6 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049160 Apr 18 13:04:02 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 135/401] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 13:04:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1630865357", "imageRef": "68265051-53bd-4952-9322-7c15e93b6a43", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b1161c0c-5352-4d95-a8fc-0d1bdb88b6ff"}], "security_groups": [{"name": "tempest-securitygroup--739925464"}], "key_name": "tempest-keypair-1283719245", "user_data": "}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.network.neutron [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] validate_networks() for [('b1161c0c-5352-4d95-a8fc-0d1bdb88b6ff', None, None, None, None, None)] {{(pid=61394) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Flavor limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Image limits 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Flavor pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Image pref 0:0:0 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.virt.hardware [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.quota [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Getting quotas for user 3c9ec5bee5f54903a88a917d6cf955bb and project 72a5f3c3f0904284b7b856f4dff441ff. Resources: {'cores', 'ram', 'instances'} {{(pid=61394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Going to run 1 instances... {{(pid=61394) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 13:04:04 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='68265051-53bd-4952-9322-7c15e93b6a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 13:04:04 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-7c50657c-ae6d-46a5-a2f4-87e6aef20f67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.789467 Apr 18 13:04:04 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 136/402] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 13:04:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 13:04:04 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-ab179b9a-2dcb-40df-b255-be50ecec881e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:04 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-ab179b9a-2dcb-40df-b255-be50ecec881e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:04 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-ab179b9a-2dcb-40df-b255-be50ecec881e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:04 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-ab179b9a-2dcb-40df-b255-be50ecec881e tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 200 len: 1236 microversion: 2.1 time: 0.072352 Apr 18 13:04:04 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 132/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:04 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:06 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebce7f1474348bb92265e98d418f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7505bc42ae4268916430a419df38cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:06 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-efb4fab9-18f0-4a09-8508-75750c357e69 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c" status: 200 len: 1569 microversion: 2.1 time: 0.241372 Apr 18 13:04:06 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 136/404] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:06 2023] GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:07 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:07 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-8cb3c6b5-dbe4-4e3f-bb76-090df2c1b7fc tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.166526 Apr 18 13:04:07 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 13:04:07 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824/os-interface => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-228c1c6b-f17d-43a7-a923-8267c521f987 req-e380ffcf-9d5c-4a84-bbb1-83854d343430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:07 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-228c1c6b-f17d-43a7-a923-8267c521f987 req-e380ffcf-9d5c-4a84-bbb1-83854d343430 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:07 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-228c1c6b-f17d-43a7-a923-8267c521f987 req-e380ffcf-9d5c-4a84-bbb1-83854d343430 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:07 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-228c1c6b-f17d-43a7-a923-8267c521f987 req-e380ffcf-9d5c-4a84-bbb1-83854d343430 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-228c1c6b-f17d-43a7-a923-8267c521f987 req-e380ffcf-9d5c-4a84-bbb1-83854d343430 service nova] Creating event network-changed:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:04:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-228c1c6b-f17d-43a7-a923-8267c521f987 req-e380ffcf-9d5c-4a84-bbb1-83854d343430 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030882 Apr 18 13:04:07 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 133/406] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:08 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-bcd6d460-b731-43fb-8dcc-7fc8be4e3558 req-4b319d13-09d5-4210-adc2-9b26a34ff15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-bcd6d460-b731-43fb-8dcc-7fc8be4e3558 req-4b319d13-09d5-4210-adc2-9b26a34ff15f service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-bcd6d460-b731-43fb-8dcc-7fc8be4e3558 req-4b319d13-09d5-4210-adc2-9b26a34ff15f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:08 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-bcd6d460-b731-43fb-8dcc-7fc8be4e3558 req-4b319d13-09d5-4210-adc2-9b26a34ff15f service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:08 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-bcd6d460-b731-43fb-8dcc-7fc8be4e3558 req-4b319d13-09d5-4210-adc2-9b26a34ff15f service nova] Creating event network-changed:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:04:08 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-bcd6d460-b731-43fb-8dcc-7fc8be4e3558 req-4b319d13-09d5-4210-adc2-9b26a34ff15f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042454 Apr 18 13:04:08 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 137/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:08 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Going to try to terminate instance {{(pid=61394) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:04:08 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-19e77347-12af-4236-bb7e-ebd9d2de7aab tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c" status: 204 len: 0 microversion: 2.1 time: 0.116651 Apr 18 13:04:08 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:04:08 2023] DELETE /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:08 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebce7f1474348bb92265e98d418f72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7505bc42ae4268916430a419df38cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:08 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-575d95a0-bfd5-4625-9ebc-0c082dadb9ea tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c" status: 200 len: 1575 microversion: 2.1 time: 0.342985 Apr 18 13:04:08 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 134/409] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:08 2023] GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c => generated 1575 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:09 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:09 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-e8ce3f4c-8f3c-4d93-b8e7-a72fe350b585 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824/ips" status: 200 len: 144 microversion: 2.1 time: 0.036595 Apr 18 13:04:09 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 138/410] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:04:09 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:09 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004b8940-ac51-48da-b4db-91a26934985c", "name": "network-vif-unplugged", "status": "completed", "tag": "56d6f513-caa2-4875-822d-fe2fd731b2ea"}, {"server_uuid": "004b8940-ac51-48da-b4db-91a26934985c", "name": "network-vif-plugged", "status": "completed", "tag": "56d6f513-caa2-4875-822d-fe2fd731b2ea"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:09 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:09 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] Creating event network-vif-unplugged:56d6f513-caa2-4875-822d-fe2fd731b2ea for instance 004b8940-ac51-48da-b4db-91a26934985c on user Apr 18 13:04:09 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] Creating event network-vif-plugged:56d6f513-caa2-4875-822d-fe2fd731b2ea for instance 004b8940-ac51-48da-b4db-91a26934985c on user Apr 18 13:04:09 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-9a92c4a3-c7e9-4dbe-be06-d31c7f5374fd req-cc50d1cb-b0db-4640-9861-d70e418a30df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030207 Apr 18 13:04:09 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 139/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:10 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:04:10 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-b52082d1-104f-46cd-8f16-648decbbbad3 req-38575a09-7949-41a8-9769-5ffa1911d978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "004b8940-ac51-48da-b4db-91a26934985c", "name": "network-vif-deleted", "tag": "56d6f513-caa2-4875-822d-fe2fd731b2ea"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-b52082d1-104f-46cd-8f16-648decbbbad3 req-38575a09-7949-41a8-9769-5ffa1911d978 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-b52082d1-104f-46cd-8f16-648decbbbad3 req-38575a09-7949-41a8-9769-5ffa1911d978 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:10 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-b52082d1-104f-46cd-8f16-648decbbbad3 req-38575a09-7949-41a8-9769-5ffa1911d978 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:10 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-b52082d1-104f-46cd-8f16-648decbbbad3 req-38575a09-7949-41a8-9769-5ffa1911d978 service nova] Creating event network-vif-deleted:56d6f513-caa2-4875-822d-fe2fd731b2ea for instance 004b8940-ac51-48da-b4db-91a26934985c on user Apr 18 13:04:10 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-b52082d1-104f-46cd-8f16-648decbbbad3 req-38575a09-7949-41a8-9769-5ffa1911d978 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028432 Apr 18 13:04:10 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 139/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:10 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-a4b7eff0-4c65-4044-b3f3-71c7c07fcd88 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 204 len: 0 microversion: 2.1 time: 0.114156 Apr 18 13:04:10 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 135/413] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:04:10 2023] DELETE /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:10 user devstack@n-api.service[61394]: DEBUG nova.policy [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50769941c80e49539e5a6b8b027c0463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd0e11306684aa891b435589dafe377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61394) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:10 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-adbb2b81-67f9-4552-99cf-733a6c82d83a tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 200 len: 1661 microversion: 2.1 time: 0.202949 Apr 18 13:04:10 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 140/414] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:10 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 1661 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 16b73b48-5c5d-4c77-88e0-3c473f659d6d] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] HTTP exception thrown: Instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d could not be found. Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Request method failure captured: Apr 18 13:04:11 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d HTTP/1.1 Apr 18 13:04:11 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:04:11 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:04:11 user devstack@n-api.service[61395]: Connection: close Apr 18 13:04:11 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:04:11 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:04:11 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:04:11 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:04:11 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpNMJXD0HO-FgJ0YHuBBOw0Fkzec-KZtPL4V3azLWHYng0lT6miJyjmxwcD3UU2nDXkkSoXpiVastnq2zCMgI-I87tErg_OrFHpyLKm0X6ePQBY4ZKqYOkUEPIwTwfxgoUZq8SZRrXHLO5okLUTkPdbyZ16m_iLRM3MhR1rske4bXCk Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Project-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Tenant-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 13:04:11 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:04:11 user devstack@n-api.service[61395]: X-User: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 13:04:11 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:04:11 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:04:11 user devstack@n-api.service[61395]: X-User-Id: c85d24916dfd4caba3c62d5a25d4b18f Apr 18 13:04:11 user devstack@n-api.service[61395]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 13:04:11 user devstack@n-api.service[61395]: method: > Apr 18 13:04:11 user devstack@n-api.service[61395]: exception: Instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d could not be found. Apr 18 13:04:11 user devstack@n-api.service[61395]: action_args: {'id': '16b73b48-5c5d-4c77-88e0-3c473f659d6d'} Apr 18 13:04:11 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d could not be found. Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d could not be found. Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d could not be found. Apr 18 13:04:11 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Returning 404 to user: Instance 16b73b48-5c5d-4c77-88e0-3c473f659d6d could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:04:11 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-c9395206-0281-4bdc-9c3f-be34a28d6735 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d" status: 404 len: 111 microversion: 2.87 time: 0.029263 Apr 18 13:04:11 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 140/415] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:04:11 2023] GET /compute/v2.1/servers/16b73b48-5c5d-4c77-88e0-3c473f659d6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Going to try to terminate instance {{(pid=61393) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:04:11 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-e3b0c571-05d7-43da-b647-3228a801fa99 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041" status: 204 len: 0 microversion: 2.87 time: 0.128154 Apr 18 13:04:11 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 136/416] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 13:04:11 2023] DELETE /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 13:04:11 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "name": "network-vif-plugged", "status": "completed", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}, {"server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "name": "network-vif-plugged", "status": "completed", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:11 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] Creating event network-vif-plugged:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:04:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] Creating event network-vif-plugged:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:04:11 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-bad6b044-7e51-4d70-9e20-872b3a474031 req-49350088-599a-4ce5-9d15-6dec008efba1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039559 Apr 18 13:04:11 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 141/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:11 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c85d24916dfd4caba3c62d5a25d4b18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf35078a110c4689bbb41c77df70d9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:11 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-af71bf26-eed2-496a-8356-1835d6558ed8 tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041" status: 200 len: 1697 microversion: 2.87 time: 0.357607 Apr 18 13:04:11 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 141/418] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:04:11 2023] GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 => generated 1697 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 13:04:12 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "name": "network-vif-unplugged", "status": "completed", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}, {"server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "name": "network-vif-plugged", "status": "completed", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}, {"server_uuid": "cf898fd6-f333-4e4d-84d0-d6d832fa0824", "name": "network-vif-deleted", "tag": "2d5a6a58-248c-4da6-ae10-76239f37f0c2"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:12 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:12 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:12 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Creating event network-vif-unplugged:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:04:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Creating event network-vif-plugged:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:04:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] Creating event network-vif-deleted:2d5a6a58-248c-4da6-ae10-76239f37f0c2 for instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 on user Apr 18 13:04:12 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-22eb3b6d-fc59-4a61-9741-31655ca48ed6 req-7b543797-e8c4-495e-a3cd-495615e21ee0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.030863 Apr 18 13:04:12 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 137/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:12 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:13 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97887118-b881-4406-9a78-955265a49041", "name": "network-vif-unplugged", "status": "completed", "tag": "c31841c1-1b3a-4496-9b34-1996d37c3983"}, {"server_uuid": "97887118-b881-4406-9a78-955265a49041", "name": "network-vif-plugged", "status": "completed", "tag": "c31841c1-1b3a-4496-9b34-1996d37c3983"}, {"server_uuid": "97887118-b881-4406-9a78-955265a49041", "name": "network-vif-deleted", "tag": "c31841c1-1b3a-4496-9b34-1996d37c3983"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:04:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:13 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Creating event network-vif-unplugged:c31841c1-1b3a-4496-9b34-1996d37c3983 for instance 97887118-b881-4406-9a78-955265a49041 on user Apr 18 13:04:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Creating event network-vif-plugged:c31841c1-1b3a-4496-9b34-1996d37c3983 for instance 97887118-b881-4406-9a78-955265a49041 on user Apr 18 13:04:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] Creating event network-vif-deleted:c31841c1-1b3a-4496-9b34-1996d37c3983 for instance 97887118-b881-4406-9a78-955265a49041 on user Apr 18 13:04:13 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-c6a274f3-c625-4dd6-91c4-1d415e4510d7 req-b0973c33-f27d-4b5b-a4c6-5a436eebeee1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032604 Apr 18 13:04:13 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 142/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:04:13 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell0:SELECT=4 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:54 user devstack@n-api.service[61395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 13:04:54 user devstack@n-api.service[61395]: Tue Apr 18 13:04:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 (ip 10.0.0.210) !!! Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=22 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:54 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:55 user devstack@n-api.service[61395]: DEBUG nova.policy [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61395) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:04:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-10c1eb76-6186-4e2d-b3d9-637a9d1ba572 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 200 len: 1546 microversion: 2.1 time: 0.243505 Apr 18 13:04:55 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:54 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 1546 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell0:SELECT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] [instance: 004b8940-ac51-48da-b4db-91a26934985c] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:04:58 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] HTTP exception thrown: Instance 004b8940-ac51-48da-b4db-91a26934985c could not be found. Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Request method failure captured: Apr 18 13:04:58 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c HTTP/1.1 Apr 18 13:04:58 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:04:58 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:04:58 user devstack@n-api.service[61393]: Connection: close Apr 18 13:04:58 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:04:58 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:04:58 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:04:58 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:04:58 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpTPWz5cxZR1No4qegYLK_ujtffdERvuIcJOCeDADxbmx5Gdq8oaUhj-vYWO9O2Hl5hZWSOPX-5Tx0DYDy36txWQFElZYN59LiYs_2guoRewgoBwDS9B70m79nbZsDy6ZJrkUfAjP9R2D38z3S1GzTuWg7CYx1LmtmxEB34-uNWAtmc Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Project-Id: 9a7505bc42ae4268916430a419df38cd Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Project-Name: tempest-SnapshotDataIntegrityTests-14881042 Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7505bc42ae4268916430a419df38cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9a7505bc42ae4268916430a419df38cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9a7505bc42ae4268916430a419df38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Tenant: tempest-SnapshotDataIntegrityTests-14881042 Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Tenant-Id: 9a7505bc42ae4268916430a419df38cd Apr 18 13:04:58 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-14881042 Apr 18 13:04:58 user devstack@n-api.service[61393]: X-User: tempest-SnapshotDataIntegrityTests-14881042-project-member Apr 18 13:04:58 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:04:58 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:04:58 user devstack@n-api.service[61393]: X-User-Id: 0ebce7f1474348bb92265e98d418f72e Apr 18 13:04:58 user devstack@n-api.service[61393]: X-User-Name: tempest-SnapshotDataIntegrityTests-14881042-project-member Apr 18 13:04:58 user devstack@n-api.service[61393]: method: > Apr 18 13:04:58 user devstack@n-api.service[61393]: exception: Instance 004b8940-ac51-48da-b4db-91a26934985c could not be found. Apr 18 13:04:58 user devstack@n-api.service[61393]: action_args: {'id': '004b8940-ac51-48da-b4db-91a26934985c'} Apr 18 13:04:58 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 004b8940-ac51-48da-b4db-91a26934985c could not be found. Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 004b8940-ac51-48da-b4db-91a26934985c could not be found. Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 004b8940-ac51-48da-b4db-91a26934985c could not be found. Apr 18 13:04:58 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:04:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Returning 404 to user: Instance 004b8940-ac51-48da-b4db-91a26934985c could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:04:58 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-7c6c1902-0985-4f07-8754-5a529ddc3585 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c" status: 404 len: 111 microversion: 2.1 time: 0.036623 Apr 18 13:04:58 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 138/422] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:04:58 2023] GET /compute/v2.1/servers/004b8940-ac51-48da-b4db-91a26934985c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:04:59 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=2 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:59 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell0:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:59 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:59 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:04:59 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-50feb8b0-0205-4171-b310-b5609436d992 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] Calling method '.version_select at 0x7fcf0cc2a5f0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:04:59 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-50feb8b0-0205-4171-b310-b5609436d992 tempest-SnapshotDataIntegrityTests-14881042 tempest-SnapshotDataIntegrityTests-14881042-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-750370206" status: 202 len: 0 microversion: 2.1 time: 0.034739 Apr 18 13:04:59 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 143/423] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 13:04:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-750370206 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] HTTP exception thrown: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Request method failure captured: Apr 18 13:05:01 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 HTTP/1.1 Apr 18 13:05:01 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:05:01 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:05:01 user devstack@n-api.service[61395]: Connection: close Apr 18 13:05:01 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:05:01 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:05:01 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:05:01 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:05:01 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpQtiVI8FiR8ehHtCDHItj0RBeYAguUAwMUa4aOKKfTpU4UAImmnZXusHYVVfJvXyatxbCWvNbTdj8n7wxInvfDMd4hkev_KJ8LIgYSwHngMT1wBmsx-zR34sDv4i4iPvfB1JUVOA-QFyAZlk4ckm60dx1pxJd9H8ay0rUTuOmWomTs Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Project-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9fd0e11306684aa891b435589dafe377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Tenant-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:01 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:05:01 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:05:01 user devstack@n-api.service[61395]: X-User-Id: 50769941c80e49539e5a6b8b027c0463 Apr 18 13:05:01 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:01 user devstack@n-api.service[61395]: method: > Apr 18 13:05:01 user devstack@n-api.service[61395]: exception: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61395]: action_args: {'id': 'cf898fd6-f333-4e4d-84d0-d6d832fa0824'} Apr 18 13:05:01 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Returning 404 to user: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-a154bc2c-d542-4922-b3af-d41ab0967cf2 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 404 len: 111 microversion: 2.1 time: 0.133735 Apr 18 13:05:01 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 143/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:05:00 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:01 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-dfcff82a-3eb4-46dc-8179-053557c80968 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '.version_select at 0x7fcf0cbcadd0>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:01 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-dfcff82a-3eb4-46dc-8179-053557c80968 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332974696" status: 202 len: 0 microversion: 2.1 time: 0.021273 Apr 18 13:05:01 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 139/425] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 13:05:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332974696 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] [instance: 97887118-b881-4406-9a78-955265a49041] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:01 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] HTTP exception thrown: Instance 97887118-b881-4406-9a78-955265a49041 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Request method failure captured: Apr 18 13:05:01 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 HTTP/1.1 Apr 18 13:05:01 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:05:01 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:05:01 user devstack@n-api.service[61394]: Connection: close Apr 18 13:05:01 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:05:01 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:05:01 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:05:01 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:05:01 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpNMJXD0HO-FgJ0YHuBBOw0Fkzec-KZtPL4V3azLWHYng0lT6miJyjmxwcD3UU2nDXkkSoXpiVastnq2zCMgI-I87tErg_OrFHpyLKm0X6ePQBY4ZKqYOkUEPIwTwfxgoUZq8SZRrXHLO5okLUTkPdbyZ16m_iLRM3MhR1rske4bXCk Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Project-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf35078a110c4689bbb41c77df70d9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Tenant-Id: cf35078a110c4689bbb41c77df70d9fa Apr 18 13:05:01 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361 Apr 18 13:05:01 user devstack@n-api.service[61394]: X-User: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 13:05:01 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:05:01 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:05:01 user devstack@n-api.service[61394]: X-User-Id: c85d24916dfd4caba3c62d5a25d4b18f Apr 18 13:05:01 user devstack@n-api.service[61394]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member Apr 18 13:05:01 user devstack@n-api.service[61394]: method: > Apr 18 13:05:01 user devstack@n-api.service[61394]: exception: Instance 97887118-b881-4406-9a78-955265a49041 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61394]: action_args: {'id': '97887118-b881-4406-9a78-955265a49041'} Apr 18 13:05:01 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97887118-b881-4406-9a78-955265a49041 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97887118-b881-4406-9a78-955265a49041 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97887118-b881-4406-9a78-955265a49041 could not be found. Apr 18 13:05:01 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:01 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] Returning 404 to user: Instance 97887118-b881-4406-9a78-955265a49041 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:01 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-586d6ba4-685b-4df9-b8c6-74d58615fd8f tempest-ServerBootFromVolumeStableRescueTest-561574361 tempest-ServerBootFromVolumeStableRescueTest-561574361-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041" status: 404 len: 111 microversion: 2.87 time: 0.033118 Apr 18 13:05:01 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 144/426] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 13:05:01 2023] GET /compute/v2.1/servers/97887118-b881-4406-9a78-955265a49041 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] HTTP exception thrown: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Request method failure captured: Apr 18 13:05:02 user devstack@n-api.service[61395]: request: DELETE /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 HTTP/1.1 Apr 18 13:05:02 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:05:02 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:05:02 user devstack@n-api.service[61395]: Connection: close Apr 18 13:05:02 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:05:02 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:05:02 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:05:02 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:05:02 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpQtiVI8FiR8ehHtCDHItj0RBeYAguUAwMUa4aOKKfTpU4UAImmnZXusHYVVfJvXyatxbCWvNbTdj8n7wxInvfDMd4hkev_KJ8LIgYSwHngMT1wBmsx-zR34sDv4i4iPvfB1JUVOA-QFyAZlk4ckm60dx1pxJd9H8ay0rUTuOmWomTs Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9fd0e11306684aa891b435589dafe377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Tenant-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Id: 50769941c80e49539e5a6b8b027c0463 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61395]: method: > Apr 18 13:05:02 user devstack@n-api.service[61395]: exception: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: action_args: {'id': 'cf898fd6-f333-4e4d-84d0-d6d832fa0824'} Apr 18 13:05:02 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Returning 404 to user: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:02 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-20bced8c-642c-4611-875e-1698e27cebf3 tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 404 len: 111 microversion: 2.1 time: 0.036049 Apr 18 13:05:02 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:05:02 2023] DELETE /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: cf898fd6-f333-4e4d-84d0-d6d832fa0824] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] HTTP exception thrown: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Request method failure captured: Apr 18 13:05:02 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 HTTP/1.1 Apr 18 13:05:02 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:05:02 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:05:02 user devstack@n-api.service[61393]: Connection: close Apr 18 13:05:02 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:05:02 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:05:02 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:05:02 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:05:02 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpQtiVI8FiR8ehHtCDHItj0RBeYAguUAwMUa4aOKKfTpU4UAImmnZXusHYVVfJvXyatxbCWvNbTdj8n7wxInvfDMd4hkev_KJ8LIgYSwHngMT1wBmsx-zR34sDv4i4iPvfB1JUVOA-QFyAZlk4ckm60dx1pxJd9H8ay0rUTuOmWomTs Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Project-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9fd0e11306684aa891b435589dafe377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Tenant-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-User: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61393]: X-User-Id: 50769941c80e49539e5a6b8b027c0463 Apr 18 13:05:02 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61393]: method: > Apr 18 13:05:02 user devstack@n-api.service[61393]: exception: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61393]: action_args: {'id': 'cf898fd6-f333-4e4d-84d0-d6d832fa0824'} Apr 18 13:05:02 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Returning 404 to user: Instance cf898fd6-f333-4e4d-84d0-d6d832fa0824 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:02 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-c9353e91-5e0a-4efe-ad8c-7a6aeb13764d tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824" status: 404 len: 111 microversion: 2.1 time: 0.032644 Apr 18 13:05:02 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 140/428] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:05:02 2023] GET /compute/v2.1/servers/cf898fd6-f333-4e4d-84d0-d6d832fa0824 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] HTTP exception thrown: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Request method failure captured: Apr 18 13:05:02 user devstack@n-api.service[61394]: request: DELETE /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 HTTP/1.1 Apr 18 13:05:02 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:05:02 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:05:02 user devstack@n-api.service[61394]: Connection: close Apr 18 13:05:02 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:05:02 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:05:02 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:05:02 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:05:02 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpQtiVI8FiR8ehHtCDHItj0RBeYAguUAwMUa4aOKKfTpU4UAImmnZXusHYVVfJvXyatxbCWvNbTdj8n7wxInvfDMd4hkev_KJ8LIgYSwHngMT1wBmsx-zR34sDv4i4iPvfB1JUVOA-QFyAZlk4ckm60dx1pxJd9H8ay0rUTuOmWomTs Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Project-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9fd0e11306684aa891b435589dafe377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Tenant-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61394]: X-User-Id: 50769941c80e49539e5a6b8b027c0463 Apr 18 13:05:02 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61394]: method: > Apr 18 13:05:02 user devstack@n-api.service[61394]: exception: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61394]: action_args: {'id': '69e88655-c926-4b02-bb0e-35fba9f129a1'} Apr 18 13:05:02 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Returning 404 to user: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:02 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-455da072-e986-4d84-8226-5e4a574bfb0b tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 404 len: 111 microversion: 2.1 time: 0.032390 Apr 18 13:05:02 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 145/429] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:05:02 2023] DELETE /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] [instance: 69e88655-c926-4b02-bb0e-35fba9f129a1] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:02 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] HTTP exception thrown: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Request method failure captured: Apr 18 13:05:02 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 HTTP/1.1 Apr 18 13:05:02 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:05:02 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:05:02 user devstack@n-api.service[61395]: Connection: close Apr 18 13:05:02 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:05:02 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:05:02 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:05:02 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:05:02 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpQtiVI8FiR8ehHtCDHItj0RBeYAguUAwMUa4aOKKfTpU4UAImmnZXusHYVVfJvXyatxbCWvNbTdj8n7wxInvfDMd4hkev_KJ8LIgYSwHngMT1wBmsx-zR34sDv4i4iPvfB1JUVOA-QFyAZlk4ckm60dx1pxJd9H8ay0rUTuOmWomTs Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9fd0e11306684aa891b435589dafe377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9fd0e11306684aa891b435589dafe377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Tenant-Id: 9fd0e11306684aa891b435589dafe377 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1095639210 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Id: 50769941c80e49539e5a6b8b027c0463 Apr 18 13:05:02 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeTestJSON-1095639210-project-member Apr 18 13:05:02 user devstack@n-api.service[61395]: method: > Apr 18 13:05:02 user devstack@n-api.service[61395]: exception: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: action_args: {'id': '69e88655-c926-4b02-bb0e-35fba9f129a1'} Apr 18 13:05:02 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. Apr 18 13:05:02 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:02 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] Returning 404 to user: Instance 69e88655-c926-4b02-bb0e-35fba9f129a1 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:02 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-dad5a9c0-8898-418e-9d21-9fcc434103fa tempest-AttachVolumeTestJSON-1095639210 tempest-AttachVolumeTestJSON-1095639210-project-member] 10.0.0.210 "GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1" status: 404 len: 111 microversion: 2.1 time: 0.026886 Apr 18 13:05:02 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 145/430] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:05:02 2023] GET /compute/v2.1/servers/69e88655-c926-4b02-bb0e-35fba9f129a1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-732a8438-2547-4536-b01d-7fec9f3a63a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cbc9870>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1823334357", "metadata": {"Type": "work"}}} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-732a8438-2547-4536-b01d-7fec9f3a63a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Request method failure captured: Apr 18 13:05:07 user devstack@n-api.service[61393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 13:05:07 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:05:07 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:05:07 user devstack@n-api.service[61393]: Connection: close Apr 18 13:05:07 user devstack@n-api.service[61393]: Content-Length: 122 Apr 18 13:05:07 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:05:07 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:05:07 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:05:07 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpWCgtPK_FzXv_vdUYW3RprDycIdxLOaCGEbTDv_vlrx2GagKpWscuFaFOHexEESMGgNUJF7h6WajrUqWmR8gnxijCt843QpX6beDtHMbfQK-cRBc_jBdWWf6vLlB6D1KZuUMIUFttee8ZELq17zLQ3zb94oCr0evOfzMWy1WjW73VI Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Id: 68233a9ffb6049769b0f2c72c36b98d7 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Name: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61393]: Apr 18 13:05:07 user devstack@n-api.service[61393]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1823334357", "metadata": {"Type": "work"}}} Apr 18 13:05:07 user devstack@n-api.service[61393]: method: Apr 18 13:05:07 user devstack@n-api.service[61393]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61393]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1823334357', 'metadata': {'Type': 'work'}}}} Apr 18 13:05:07 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise error Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-732a8438-2547-4536-b01d-7fec9f3a63a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-732a8438-2547-4536-b01d-7fec9f3a63a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.225912 Apr 18 13:05:07 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 141/431] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 13:05:07 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-16eb569a-50ac-4b38-a7ca-c873960529a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Action: 'create', calling method: .version_select at 0x7fcf0cc2aef0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1442627952", "metadata": {"Type": "work"}}} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:05:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-16eb569a-50ac-4b38-a7ca-c873960529a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Request method failure captured: Apr 18 13:05:07 user devstack@n-api.service[61394]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 13:05:07 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:05:07 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:05:07 user devstack@n-api.service[61394]: Connection: close Apr 18 13:05:07 user devstack@n-api.service[61394]: Content-Length: 120 Apr 18 13:05:07 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:05:07 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:05:07 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:05:07 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpWCgtPK_FzXv_vdUYW3RprDycIdxLOaCGEbTDv_vlrx2GagKpWscuFaFOHexEESMGgNUJF7h6WajrUqWmR8gnxijCt843QpX6beDtHMbfQK-cRBc_jBdWWf6vLlB6D1KZuUMIUFttee8ZELq17zLQ3zb94oCr0evOfzMWy1WjW73VI Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Tenant: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Tenant-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Id: 68233a9ffb6049769b0f2c72c36b98d7 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Name: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61394]: Apr 18 13:05:07 user devstack@n-api.service[61394]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1442627952", "metadata": {"Type": "work"}}} Apr 18 13:05:07 user devstack@n-api.service[61394]: method: Apr 18 13:05:07 user devstack@n-api.service[61394]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 13:05:07 user devstack@n-api.service[61394]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1442627952', 'metadata': {'Type': 'work'}}}} Apr 18 13:05:07 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise error Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi '0' Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-16eb569a-50ac-4b38-a7ca-c873960529a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:07 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-16eb569a-50ac-4b38-a7ca-c873960529a7 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011844 Apr 18 13:05:07 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 146/432] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 13:05:07 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-0928bd98-65d6-4472-bcf9-a78aa8cd2fd8 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Action: 'create', calling method: .version_select at 0x7fcf0e4b9870>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1502124375", "metadata": {"Type": "work"}}} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:05:07 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-0928bd98-65d6-4472-bcf9-a78aa8cd2fd8 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Request method failure captured: Apr 18 13:05:07 user devstack@n-api.service[61395]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 13:05:07 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:05:07 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:05:07 user devstack@n-api.service[61395]: Connection: close Apr 18 13:05:07 user devstack@n-api.service[61395]: Content-Length: 119 Apr 18 13:05:07 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:05:07 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:05:07 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:05:07 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpWCgtPK_FzXv_vdUYW3RprDycIdxLOaCGEbTDv_vlrx2GagKpWscuFaFOHexEESMGgNUJF7h6WajrUqWmR8gnxijCt843QpX6beDtHMbfQK-cRBc_jBdWWf6vLlB6D1KZuUMIUFttee8ZELq17zLQ3zb94oCr0evOfzMWy1WjW73VI Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Project-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Project-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Tenant: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Tenant-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61395]: X-User: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61395]: X-User-Id: 68233a9ffb6049769b0f2c72c36b98d7 Apr 18 13:05:07 user devstack@n-api.service[61395]: X-User-Name: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61395]: Apr 18 13:05:07 user devstack@n-api.service[61395]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1502124375", "metadata": {"Type": "work"}}} Apr 18 13:05:07 user devstack@n-api.service[61395]: method: Apr 18 13:05:07 user devstack@n-api.service[61395]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61395]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1502124375', 'metadata': {'Type': 'work'}}}} Apr 18 13:05:07 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise error Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi '' Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 13:05:07 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-0928bd98-65d6-4472-bcf9-a78aa8cd2fd8 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:07 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-0928bd98-65d6-4472-bcf9-a78aa8cd2fd8 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009670 Apr 18 13:05:07 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 146/433] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 13:05:07 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-e520d43d-8638-4b47-9538-2ec24d1f08bc tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Calling method '.version_select at 0x7fcf0ca19360>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-e520d43d-8638-4b47-9538-2ec24d1f08bc tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] HTTP exception thrown: Volume tempest-invalid-1975924786 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-e520d43d-8638-4b47-9538-2ec24d1f08bc tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Request method failure captured: Apr 18 13:05:07 user devstack@n-api.service[61393]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1975924786 HTTP/1.1 Apr 18 13:05:07 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:05:07 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:05:07 user devstack@n-api.service[61393]: Connection: close Apr 18 13:05:07 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:05:07 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:05:07 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:05:07 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:05:07 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpWCgtPK_FzXv_vdUYW3RprDycIdxLOaCGEbTDv_vlrx2GagKpWscuFaFOHexEESMGgNUJF7h6WajrUqWmR8gnxijCt843QpX6beDtHMbfQK-cRBc_jBdWWf6vLlB6D1KZuUMIUFttee8ZELq17zLQ3zb94oCr0evOfzMWy1WjW73VI Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Id: 68233a9ffb6049769b0f2c72c36b98d7 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Name: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61393]: method: Apr 18 13:05:07 user devstack@n-api.service[61393]: exception: Volume tempest-invalid-1975924786 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: action_args: {'id': 'tempest-invalid-1975924786'} Apr 18 13:05:07 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1975924786 could not be found. (HTTP 404) (Request-ID: req-c4194c4c-58e2-4b54-9a39-723d3c903f5b) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1975924786 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1975924786 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1975924786 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-e520d43d-8638-4b47-9538-2ec24d1f08bc tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Returning 404 to user: Volume tempest-invalid-1975924786 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-e520d43d-8638-4b47-9538-2ec24d1f08bc tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1975924786" status: 404 len: 99 microversion: 2.1 time: 0.039717 Apr 18 13:05:07 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 142/434] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 13:05:07 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1975924786 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-2bbd2cce-b102-411d-8ed9-5a210ab9d6e9 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003932 Apr 18 13:05:07 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 147/435] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 13:05:07 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-b16177f1-986e-4b06-832d-fd8685fb5838 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003409 Apr 18 13:05:07 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 13:05:07 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a940a137-455d-4d08-a1e8-824764d52204 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Calling method '.version_select at 0x7fcf0cbc9000>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-a940a137-455d-4d08-a1e8-824764d52204 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] HTTP exception thrown: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a940a137-455d-4d08-a1e8-824764d52204 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Request method failure captured: Apr 18 13:05:07 user devstack@n-api.service[61393]: request: DELETE /compute/v2.1/os-volumes/4ec899fb-24f3-40c7-9094-6e8ba566ec51 HTTP/1.1 Apr 18 13:05:07 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:05:07 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:05:07 user devstack@n-api.service[61393]: Connection: close Apr 18 13:05:07 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:05:07 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:05:07 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:05:07 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:05:07 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpWCgtPK_FzXv_vdUYW3RprDycIdxLOaCGEbTDv_vlrx2GagKpWscuFaFOHexEESMGgNUJF7h6WajrUqWmR8gnxijCt843QpX6beDtHMbfQK-cRBc_jBdWWf6vLlB6D1KZuUMIUFttee8ZELq17zLQ3zb94oCr0evOfzMWy1WjW73VI Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Project-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Id: 68233a9ffb6049769b0f2c72c36b98d7 Apr 18 13:05:07 user devstack@n-api.service[61393]: X-User-Name: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61393]: method: Apr 18 13:05:07 user devstack@n-api.service[61393]: exception: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: action_args: {'id': '4ec899fb-24f3-40c7-9094-6e8ba566ec51'} Apr 18 13:05:07 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. (HTTP 404) (Request-ID: req-01a7a642-b1cd-4c89-81a7-8ed1670a5578) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-a940a137-455d-4d08-a1e8-824764d52204 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Returning 404 to user: Volume 4ec899fb-24f3-40c7-9094-6e8ba566ec51 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:07 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-a940a137-455d-4d08-a1e8-824764d52204 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4ec899fb-24f3-40c7-9094-6e8ba566ec51" status: 404 len: 109 microversion: 2.1 time: 0.033175 Apr 18 13:05:07 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 143/437] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:05:07 2023] DELETE /compute/v2.1/os-volumes/4ec899fb-24f3-40c7-9094-6e8ba566ec51 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-2d42f22c-b6c9-481d-83c8-1a407915a391 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Calling method '.version_select at 0x7fcf0cca40d0>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:07 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-2d42f22c-b6c9-481d-83c8-1a407915a391 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] HTTP exception thrown: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-2d42f22c-b6c9-481d-83c8-1a407915a391 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Request method failure captured: Apr 18 13:05:07 user devstack@n-api.service[61394]: request: GET /compute/v2.1/os-volumes/c1ad5bbd-f435-47dc-ab72-cc91737108e9 HTTP/1.1 Apr 18 13:05:07 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:05:07 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:05:07 user devstack@n-api.service[61394]: Connection: close Apr 18 13:05:07 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:05:07 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:05:07 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:05:07 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:05:07 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpWCgtPK_FzXv_vdUYW3RprDycIdxLOaCGEbTDv_vlrx2GagKpWscuFaFOHexEESMGgNUJF7h6WajrUqWmR8gnxijCt843QpX6beDtHMbfQK-cRBc_jBdWWf6vLlB6D1KZuUMIUFttee8ZELq17zLQ3zb94oCr0evOfzMWy1WjW73VI Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Project-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d582bb9faaf148b3affd733a4c56655a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Tenant: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Tenant-Id: d582bb9faaf148b3affd733a4c56655a Apr 18 13:05:07 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-VolumesNegativeTest-1704682976 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Id: 68233a9ffb6049769b0f2c72c36b98d7 Apr 18 13:05:07 user devstack@n-api.service[61394]: X-User-Name: tempest-VolumesNegativeTest-1704682976-project-member Apr 18 13:05:07 user devstack@n-api.service[61394]: method: Apr 18 13:05:07 user devstack@n-api.service[61394]: exception: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61394]: action_args: {'id': 'c1ad5bbd-f435-47dc-ab72-cc91737108e9'} Apr 18 13:05:07 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. (HTTP 404) (Request-ID: req-fea997d8-85dc-415f-86c2-2225d1c9b8be) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. Apr 18 13:05:07 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:05:07 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-2d42f22c-b6c9-481d-83c8-1a407915a391 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] Returning 404 to user: Volume c1ad5bbd-f435-47dc-ab72-cc91737108e9 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:05:07 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-2d42f22c-b6c9-481d-83c8-1a407915a391 tempest-VolumesNegativeTest-1704682976 tempest-VolumesNegativeTest-1704682976-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c1ad5bbd-f435-47dc-ab72-cc91737108e9" status: 404 len: 109 microversion: 2.1 time: 0.043321 Apr 18 13:05:07 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 13:05:07 2023] GET /compute/v2.1/os-volumes/c1ad5bbd-f435-47dc-ab72-cc91737108e9 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=8 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=12 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:55 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:55 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-123af11c-9495-45ca-8f72-f785322b3ce0 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.194600 Apr 18 13:05:55 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 148/439] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 13:05:55 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0/os-interface => generated 283 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:05:56 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:05:56 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:05:56 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [req-ccf44114-4c36-42bf-aa0f-9a6c43e07cad req-4bf6f443-ea8d-4875-a5d6-9934cc3a2979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}]} {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:05:56 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-ccf44114-4c36-42bf-aa0f-9a6c43e07cad req-4bf6f443-ea8d-4875-a5d6-9934cc3a2979 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:56 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-ccf44114-4c36-42bf-aa0f-9a6c43e07cad req-4bf6f443-ea8d-4875-a5d6-9934cc3a2979 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:56 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [req-ccf44114-4c36-42bf-aa0f-9a6c43e07cad req-4bf6f443-ea8d-4875-a5d6-9934cc3a2979 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:56 user devstack@n-api.service[61393]: INFO nova.api.openstack.compute.server_external_events [req-ccf44114-4c36-42bf-aa0f-9a6c43e07cad req-4bf6f443-ea8d-4875-a5d6-9934cc3a2979 service nova] Creating event network-changed:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:05:56 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [req-ccf44114-4c36-42bf-aa0f-9a6c43e07cad req-4bf6f443-ea8d-4875-a5d6-9934cc3a2979 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038143 Apr 18 13:05:56 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 144/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:57 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:57 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-9404d6a8-2e9e-467f-9148-eccd8b215a23 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0/ips" status: 200 len: 149 microversion: 2.1 time: 0.043410 Apr 18 13:05:57 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 149/441] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 13:05:57 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:58 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Going to try to terminate instance {{(pid=61395) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 13:05:58 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-68172bce-768c-4c5c-bf0f-bebf7f81e1f2 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 204 len: 0 microversion: 2.1 time: 0.111628 Apr 18 13:05:58 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:05:58 2023] DELETE /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:58 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:58 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [req-a5b0e48f-20a9-4d3c-b87e-233433bd46f5 req-faed84a1-7b8b-43a1-be6c-5814599bee36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "name": "network-vif-unplugged", "status": "completed", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}]} {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:05:58 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a5b0e48f-20a9-4d3c-b87e-233433bd46f5 req-faed84a1-7b8b-43a1-be6c-5814599bee36 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:05:58 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a5b0e48f-20a9-4d3c-b87e-233433bd46f5 req-faed84a1-7b8b-43a1-be6c-5814599bee36 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:05:58 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [req-a5b0e48f-20a9-4d3c-b87e-233433bd46f5 req-faed84a1-7b8b-43a1-be6c-5814599bee36 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:05:58 user devstack@n-api.service[61394]: INFO nova.api.openstack.compute.server_external_events [req-a5b0e48f-20a9-4d3c-b87e-233433bd46f5 req-faed84a1-7b8b-43a1-be6c-5814599bee36 service nova] Creating event network-vif-unplugged:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:05:58 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [req-a5b0e48f-20a9-4d3c-b87e-233433bd46f5 req-faed84a1-7b8b-43a1-be6c-5814599bee36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032429 Apr 18 13:05:59 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 150/443] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:05:59 user devstack@n-api.service[61393]: DEBUG nova.policy [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9ec5bee5f54903a88a917d6cf955bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5f3c3f0904284b7b856f4dff441ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61393) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 13:05:59 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-39caa189-af00-4e56-bd53-fcf3bdc10e98 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 200 len: 1671 microversion: 2.1 time: 0.423036 Apr 18 13:05:59 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 145/444] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:05:58 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 1671 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 13:06:01 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "name": "network-vif-plugged", "status": "completed", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}, {"server_uuid": "71b87529-6f21-4797-b352-924e8aecabf0", "name": "network-vif-deleted", "tag": "e8fe9519-a132-416d-b9d9-270a200f9c5c"}]} {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 13:06:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:01 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] Creating event network-vif-plugged:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:06:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.compute.server_external_events [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] Creating event network-vif-deleted:e8fe9519-a132-416d-b9d9-270a200f9c5c for instance 71b87529-6f21-4797-b352-924e8aecabf0 on user Apr 18 13:06:01 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [req-1602bd51-583e-4484-8c2e-09c619c45b83 req-cfc31c42-7d1a-4c41-a00c-b05b48f8f869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029729 Apr 18 13:06:01 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 150/445] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 13:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_api:SELECT=4 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG dbcounter [-] [61394] Writing DB stats nova_cell1:SELECT=6 {{(pid=61394) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:06:49 user devstack@n-api.service[61394]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 13:06:49 user devstack@n-api.service[61394]: Tue Apr 18 13:06:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 (ip 10.0.0.210) !!! Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:49 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:49 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 HTTP/1.1 Apr 18 13:06:49 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:06:49 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:06:49 user devstack@n-api.service[61394]: Connection: close Apr 18 13:06:49 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:06:49 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:06:49 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:06:49 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:06:49 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:49 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:49 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:49 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:06:49 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:06:49 user devstack@n-api.service[61394]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:49 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:49 user devstack@n-api.service[61394]: method: > Apr 18 13:06:49 user devstack@n-api.service[61394]: exception: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:49 user devstack@n-api.service[61394]: action_args: {'id': '71b87529-6f21-4797-b352-924e8aecabf0'} Apr 18 13:06:49 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:49 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:49 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:49 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-205b0cdd-5768-44b8-ad1f-4d01a9ae941a tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 404 len: 111 microversion: 2.1 time: 0.037696 Apr 18 13:06:49 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 151/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:06:49 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:06:49 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5d8700e6-1c01-4647-9798-8e5f8af7829b tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '.version_select at 0x7fcf0cbcaf80>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:49 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_api:SELECT=4 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:06:49 user devstack@n-api.service[61393]: DEBUG dbcounter [-] [61393] Writing DB stats nova_cell1:SELECT=8 {{(pid=61393) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:06:49 user devstack@n-api.service[61393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 13:06:49 user devstack@n-api.service[61393]: Tue Apr 18 13:06:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1283719245 (ip 10.0.0.210) !!! Apr 18 13:06:49 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5d8700e6-1c01-4647-9798-8e5f8af7829b tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283719245" status: 202 len: 0 microversion: 2.1 time: 0.034381 Apr 18 13:06:49 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 146/447] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 13:06:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283719245 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG dbcounter [-] [61395] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61395) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:50 user devstack@n-api.service[61395]: request: DELETE /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 HTTP/1.1 Apr 18 13:06:50 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:06:50 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:06:50 user devstack@n-api.service[61395]: Connection: close Apr 18 13:06:50 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:06:50 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:06:50 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:06:50 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:06:50 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61395]: method: > Apr 18 13:06:50 user devstack@n-api.service[61395]: exception: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: action_args: {'id': '71b87529-6f21-4797-b352-924e8aecabf0'} Apr 18 13:06:50 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-5ab59897-cbed-48b2-b6c5-49125eed8403 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 404 len: 111 microversion: 2.1 time: 0.033158 Apr 18 13:06:50 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 151/448] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:06:50 2023] DELETE /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: 71b87529-6f21-4797-b352-924e8aecabf0] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:50 user devstack@n-api.service[61394]: request: GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 HTTP/1.1 Apr 18 13:06:50 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:06:50 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:06:50 user devstack@n-api.service[61394]: Connection: close Apr 18 13:06:50 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:06:50 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:06:50 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:06:50 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:06:50 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61394]: method: > Apr 18 13:06:50 user devstack@n-api.service[61394]: exception: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: action_args: {'id': '71b87529-6f21-4797-b352-924e8aecabf0'} Apr 18 13:06:50 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance 71b87529-6f21-4797-b352-924e8aecabf0 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-d2caa951-feac-4cc3-b2e2-36f574145008 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0" status: 404 len: 111 microversion: 2.1 time: 0.036031 Apr 18 13:06:50 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 152/449] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:06:50 2023] GET /compute/v2.1/servers/71b87529-6f21-4797-b352-924e8aecabf0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:50 user devstack@n-api.service[61393]: request: DELETE /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 HTTP/1.1 Apr 18 13:06:50 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:06:50 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:06:50 user devstack@n-api.service[61393]: Connection: close Apr 18 13:06:50 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:06:50 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:06:50 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:06:50 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:06:50 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61393]: method: > Apr 18 13:06:50 user devstack@n-api.service[61393]: exception: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: action_args: {'id': 'baa7cb8a-7e9f-45e2-806c-92811755d9a2'} Apr 18 13:06:50 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-58094fb6-e1c7-45c1-afa8-10025f0f2414 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 404 len: 111 microversion: 2.1 time: 0.027574 Apr 18 13:06:50 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 147/450] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:06:50 2023] DELETE /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.compute.api [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: baa7cb8a-7e9f-45e2-806c-92811755d9a2] Fetching instance by UUID {{(pid=61395) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG oslo_concurrency.lockutils [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61395) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.wsgi [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:50 user devstack@n-api.service[61395]: request: GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 HTTP/1.1 Apr 18 13:06:50 user devstack@n-api.service[61395]: Accept: application/json Apr 18 13:06:50 user devstack@n-api.service[61395]: Accept-Encoding: identity Apr 18 13:06:50 user devstack@n-api.service[61395]: Connection: close Apr 18 13:06:50 user devstack@n-api.service[61395]: Content-Length: 0 Apr 18 13:06:50 user devstack@n-api.service[61395]: Content-Type: application/json Apr 18 13:06:50 user devstack@n-api.service[61395]: Host: 10.0.0.210 Apr 18 13:06:50 user devstack@n-api.service[61395]: Openstack-System-Scope: None Apr 18 13:06:50 user devstack@n-api.service[61395]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Domain-Id: None Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Domain-Name: None Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Identity-Status: Confirmed Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Is-Admin-Project: True Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Role: member,reader Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Roles: member,reader Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:50 user devstack@n-api.service[61395]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61395]: method: > Apr 18 13:06:50 user devstack@n-api.service[61395]: exception: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: action_args: {'id': 'baa7cb8a-7e9f-45e2-806c-92811755d9a2'} Apr 18 13:06:50 user devstack@n-api.service[61395]: {{(pid=61395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61395]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61395]: DEBUG nova.api.openstack.wsgi [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance baa7cb8a-7e9f-45e2-806c-92811755d9a2 could not be found. {{(pid=61395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:50 user devstack@n-api.service[61395]: INFO nova.api.openstack.requestlog [None req-6edb7ed9-73bf-47cc-94b0-2b4f1d73be67 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2" status: 404 len: 111 microversion: 2.1 time: 0.026810 Apr 18 13:06:50 user devstack@n-api.service[61395]: [pid: 61395|app: 0|req: 152/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:06:50 2023] GET /compute/v2.1/servers/baa7cb8a-7e9f-45e2-806c-92811755d9a2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.compute.api [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61394) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG oslo_concurrency.lockutils [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61394) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.wsgi [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:50 user devstack@n-api.service[61394]: request: DELETE /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 HTTP/1.1 Apr 18 13:06:50 user devstack@n-api.service[61394]: Accept: application/json Apr 18 13:06:50 user devstack@n-api.service[61394]: Accept-Encoding: identity Apr 18 13:06:50 user devstack@n-api.service[61394]: Connection: close Apr 18 13:06:50 user devstack@n-api.service[61394]: Content-Length: 0 Apr 18 13:06:50 user devstack@n-api.service[61394]: Content-Type: application/json Apr 18 13:06:50 user devstack@n-api.service[61394]: Host: 10.0.0.210 Apr 18 13:06:50 user devstack@n-api.service[61394]: Openstack-System-Scope: None Apr 18 13:06:50 user devstack@n-api.service[61394]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Domain-Id: None Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Domain-Name: None Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Identity-Status: Confirmed Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Is-Admin-Project: True Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Role: member,reader Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Roles: member,reader Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:50 user devstack@n-api.service[61394]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61394]: method: > Apr 18 13:06:50 user devstack@n-api.service[61394]: exception: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: action_args: {'id': 'bccb0d4d-97d7-499f-8def-63ac33c430e7'} Apr 18 13:06:50 user devstack@n-api.service[61394]: {{(pid=61394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61394]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61394]: DEBUG nova.api.openstack.wsgi [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. {{(pid=61394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:50 user devstack@n-api.service[61394]: INFO nova.api.openstack.requestlog [None req-cff32f0b-4fb8-47de-9214-dc6b0a696d76 tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 404 len: 111 microversion: 2.1 time: 0.027373 Apr 18 13:06:50 user devstack@n-api.service[61394]: [pid: 61394|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 13:06:50 2023] DELETE /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Calling method '>' {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.compute.api [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] [instance: bccb0d4d-97d7-499f-8def-63ac33c430e7] Fetching instance by UUID {{(pid=61393) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Acquiring lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG oslo_concurrency.lockutils [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Lock "8e2e7804-6c25-4b7a-b3e8-114c55cd91bc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 13:06:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.wsgi [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] HTTP exception thrown: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Request method failure captured: Apr 18 13:06:50 user devstack@n-api.service[61393]: request: GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 HTTP/1.1 Apr 18 13:06:50 user devstack@n-api.service[61393]: Accept: application/json Apr 18 13:06:50 user devstack@n-api.service[61393]: Accept-Encoding: identity Apr 18 13:06:50 user devstack@n-api.service[61393]: Connection: close Apr 18 13:06:50 user devstack@n-api.service[61393]: Content-Length: 0 Apr 18 13:06:50 user devstack@n-api.service[61393]: Content-Type: application/json Apr 18 13:06:50 user devstack@n-api.service[61393]: Host: 10.0.0.210 Apr 18 13:06:50 user devstack@n-api.service[61393]: Openstack-System-Scope: None Apr 18 13:06:50 user devstack@n-api.service[61393]: User-Agent: python-urllib3/1.26.15 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Auth-Token: gAAAAABkPpP0vxXAgR9l-D1z_WhaX7iOfB1onOTB9fGAC7o3b4F2i1jGvFO-ZHzDEubuaitcr2-YCW-PqFs-969uQEdXRjkPxkqgVsIyVRPqNEp7ls1n-_55QrM73WuLtkBE_chvGzfQKPfCDfYPx8rgReMzE_VFxoBiu4_okMU3ju6oBB-QG0Y Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Domain-Id: None Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Domain-Name: None Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Identity-Status: Confirmed Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Is-Admin-Project: True Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Project-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Role: member,reader Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Roles: member,reader Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72a5f3c3f0904284b7b856f4dff441ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Tenant: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Tenant-Id: 72a5f3c3f0904284b7b856f4dff441ff Apr 18 13:06:50 user devstack@n-api.service[61393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-634656201 Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Domain-Id: default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Domain-Name: Default Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Id: 3c9ec5bee5f54903a88a917d6cf955bb Apr 18 13:06:50 user devstack@n-api.service[61393]: X-User-Name: tempest-AttachVolumeNegativeTest-634656201-project-member Apr 18 13:06:50 user devstack@n-api.service[61393]: method: > Apr 18 13:06:50 user devstack@n-api.service[61393]: exception: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: action_args: {'id': 'bccb0d4d-97d7-499f-8def-63ac33c430e7'} Apr 18 13:06:50 user devstack@n-api.service[61393]: {{(pid=61393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. Apr 18 13:06:50 user devstack@n-api.service[61393]: ERROR nova.api.openstack.wsgi Apr 18 13:06:50 user devstack@n-api.service[61393]: DEBUG nova.api.openstack.wsgi [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] Returning 404 to user: Instance bccb0d4d-97d7-499f-8def-63ac33c430e7 could not be found. {{(pid=61393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 13:06:50 user devstack@n-api.service[61393]: INFO nova.api.openstack.requestlog [None req-5ad4b545-4d67-400d-880a-04e80b5b34ff tempest-AttachVolumeNegativeTest-634656201 tempest-AttachVolumeNegativeTest-634656201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7" status: 404 len: 111 microversion: 2.1 time: 0.031026 Apr 18 13:06:50 user devstack@n-api.service[61393]: [pid: 61393|app: 0|req: 148/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 13:06:50 2023] GET /compute/v2.1/servers/bccb0d4d-97d7-499f-8def-63ac33c430e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)